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PREFACE 


The  purpose  of  this  handbook  is  to  give  its  users  basic  working  knowledge 
of  classifier  concepts,   acquaint  them  with  the  procedures  used  to  design 
the  classifier  for  the  passive  bus  detector,    and  instruct  them  in  using  the 
computer  program  that  was  used  in  the  bus  detector  classifier  design. 
The  classifier  that  was  initially  built  into  the  passive  bus  detector  was 
designed  to  recognize  the  55  passenger  urban  transit  busses  manufactured 
by  Flxible,   AMG  and  GMC  prior  to  1975  and  to  reject  all  other  vehicles 
that  use  city  streets.     The  vehicles  that  it  rejects  include  inter- city  busses, 
tour  busses  and  school  busses.     To  be  this  specific,   the  classifier  uses 
information  derived  from  the  physical  structure  of  the  vehicles.     This 
means  that  the  classifier  may  have  to  be  modified  to  recognize  busses 
made  after  1975  or  to  recognize  other  kinds  of  busses  (mini-,    articulated, 
etc.  ).     This  handbook  contains  general  examples  of  classifier  design 
problems  and  it  gives  a  detailed  description  of  the  steps  and  data  involved 
in  designing  the  original  bus  classifier. 

A  "classifier"  is  a  machine  that  observes  objects  and  events  in  the  world 
and  classifies  them  by  assigning  each  object  or  event  to  one  of  a  number 
of  different  classes.     The  bus  detector  classifier  observes  vehicles 
through  a  buried  loop  and  classifies  them  into  one  of  two  classes  -  bus  or 
non-bus.     The  word  "machine"  is  used  to  indicate  the  devices,    computers 
and  computer  programs  that  do  the  observing,    data  processing  and  decision 
making.     The  term  "pattern  recognition"  is  often  used  to  denote  the  area 
of  knowledge  that  includes  the  concepts,   theories,   methods  and  tricks  that 
are  used  to  design  classifiers.     Pattern  recognition  includes  a  sizeable 
body  of  standard  statistical  methods  that  have  been  studied  and  used  for 
decades.     It  also  includes  a  large  number  of  empirical  procedures  that 
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are  useful  in  special  problems  and  it  uses  some  purely  geometrical  con- 
cepts to  describe  and  work  with  data  in  N-dimensional  space.     This  hand- 
book attempts  to  avoid  the  esoteric  parts  of  pattern  recognition  and  stay 
within  the  bounds  of  what  can  reasonably  be  expected  to  be  useful  in  work- 
ing with  the  bus  detector  classifier. 

CHAPTER  1  of  this  handbook  discusses  the  problems  involved  in  identify- 
ing busses.     It  briefly  reviews  the  sensing  device  and  the  signal  properties 
that  make  passive  identification  possible.     This  is  then  used  to  introduce 
the  basic  ideas  of  pattern  recognition  as  they  are  used  in  the  bus  classifier. 
CHAPTER  2  presents  a  more  detailed  discussion  of  pattern  recognition, 
what  it  is,   where  it  comes  from,   what  it  can  do  and  how  it  can  be  used. 

Readers  familiar  with  optimal  classifier  theory  may  feel  that  CHAPTER 
2  violates  all  that  is  pure,    right  and  wholesome.     No  apology  is  offered, 
because  this  chapter  is  intended  to  stress  the  value  of  pictorial  methods, 
trial  and  error,    and  simple  arithmetic. 

CHAPTER  3  is  a  detailed  analysis  of  a  2 -dimensional  numerical  example. 
The  purpose  of  this  chapter  is  to  show  how  the  geometric  concepts  dis- 
cussed in  CHAPTER  2  can  be  applied  using  relatively  simple  computations. 
These  computations  (which  the  CTC  program  performs)  are  shown  in  de- 
tail.    CHAPTER  4  continues  the  same  numerical  example  and  shows  the 
input  cards  and  computer  printouts  for  solving  the  problem  with  the  CTC 
program.     The  example  is  also  extended  to  3  dimensions  to  show  how  the 
concepts  generalize.     Detailed  operating  instructions  for  the  CTC  program 
are  included  at  the  beginning  of  CHAPTER  4. 
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CHAPTER  5  contains  detailed  flowcharts  of  the  CTC  program.     This 
chapter  is  primarily  for  the  user  who  desires  to  change  the  program  or 
adapt  it  for  problems  other  than  the  bus  detector  application.     However, 
the  general  user  may  find  the  summary  given  in  Table  18  to  be  useful 
in  operating  the  program. 

CHAPTER  6  returns  to  the  bus  classifier  design  problem  and  discusses 
the  design  process  from  beginning  to  end.     This  discussion  includes  more 
detail  than  was  presented  in  the  original  Passive  Bus  Detector/Classifier 
report. 

Appendixes    A,   B  and  C  contain  the  mathematical  details  of  linear  discrim 
inant  classifiers  and  the  computations  performed  by  the  CTC  program  and 
Appendix  D  contains  a  fully  annotated  listing  of  the  CTC  program.     There 
are  certain  to  be  questions  about  the  program  function  and  operation  that 
were  not  anticipated  in  CHAPTERS  1-6.     The  appendixes     should  supply 
the  answers. 

A  brief  reference  list  is  included  at  the  end  of  the  handbook.     This  list 
contains  the  references  mentioned  in  the  text  and  it  lists  two  recent  text 
books  (Meisel,   Fu)  that  are  particularly  good  in  presenting  the  theory  and 
the  state-of-the-art  of  pattern  recognition. 

I  wish  to  gratefully  acknowledge  the  assistance  from  Bob  Touchberry, 
Tony  Tennis  and  Dave  Brown  in  preparing  and  assembling  the  material 
contained  in  this  handbook. 
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CHAPTER  1 
THE  PASSIVE  BUS  DETECTOR  PROBLEM 


The  passive  bus  detector  senses  vehicles  with  a  6-foot*by  6-foot*inductive 
loop  buried  in  the  roadway.     The  loop  is  driven  by  100  kHz  oscillator  and  the 
phase  of  the  signal  is  monitored  by  the  loop  electronics.     When  a  vehicle 
passes  over  the  loop,  the  metal  in  the  vehicle  changes  the  self  inductance  of 
the  loop  and  this  causes  the  phase     of  the  induced  signal  to  change.     Since 
the  self  inductance  depends  on  the  position  and  amount  of  metal  inside  the 
loop,   it  changes  with  time  as  the  vehicle  moves  over  the  loop  and  the  phase 
also  changes  with  time.     The  bus  detector  observes  the  instantaneous  phase 
of  the  induced  signal.     This  is  a  waveform  that  is  determined  by  the  kind  of 
vehicle,  the  path  it  takes  over  the  loop  and  the  speed  at  which  it  is  traveling. 
Figure  1  shows  the  waveform  generated  by  a  1972  Flxible  4^-footx"bus  travel- 
ing at  a  constant  speed  over  the  loop.     The  waveform  has  three  "humps,  "  the 
first  is  due  to  the  front  axle,   the  second  to  the  fuel  tank  and  the  last  to  the 
rear  axle  and  motor. 

Figure  2  shows  similar  waveforms  generated  by  five  other  vehicles.     The 
dray  truck  and  step  van  each  show  two  distinct  humps  caused  by  the  front 
and  rear  axles  and  the  station  wagon  shows  a  slight  dip  in  the  middle.     The 
Torino  and  the  Bug  only  have  one  hump  because  the  axles  are  so  close  to- 
gether that  they  both  influence  the  loop  at  the  same  time. 

The  waveform  shapes  in  these  examples  are  characteristic  of  the  different 
kinds  of  vehicles,    i.  e.  busses  have  three  humps,   trucks  have  two  and  cars 
have  one.     A  human  can  quite  easily  distinguish  between  busses  and  other 
vehicles  from  the  shapes  of  their  waveforms.     It  would  seem  then  that  a  ma- 
chine could  do  the  classifying  simply  by  counting  the  number  of  humps  in  the 
waveform.     Unfortunately,   there  are  other  vehicles  that  also  generate  three 

*     6  ft.   =  1.8  m 
kO  ft.    =  12.2  m 
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Figure  1.     Waveform  produced  by  a  1972  Flxible  40-foofbus 

(See  Volume  III,   "Vehicle  Signature  Acquisition,  " 
of  Final  Report  on  Passive  Bus  Detector /Inter- 
section Priority  System  Development,   Report  No. 
FHWA-RD-76-66  for  detailed  information  on  signal 
amplitudes  and  sensor  characteristics.  ) 


humps;  semitractor  trailers  have  three  axles  that  are  far  enough  apart  to  show 
up  separately.     Thus,   three  humps  is  not  sufficient  to  identfy  a  bus.     However, 
the  semi  has  a  long  distance  between  the  second  and  third  axle  while  the  mid- 
dle hump  of  a  bus  is  in  the  center  of  the  signal.     This  extra  characteristic 
is  almost  enough  to  do  the  job,   but  there  is  a  problem  with  busses  that  stop 
or  slow  down  while  they  are  crossing  the  loop.     The  change  in  speed  can 
cause  the  distance  between  the  second  and  third  humps  of  a  bus  signal  to  be 
farther  apart  than  normal  and  cause  it  to  be  confused  with  a  semi.     Another 
problem  comes  from  drop-bed  moving  vans.     They  generate  a  hump  that  is 
in  the  middle  of  the  signal  and  are  easily  confused  with  busses.     However,    if 
we  consider  the  size  of  the  humps  we  find  that  the  three  humps  of  busses  are 
almost  equal,   a  semi  has  a  small  second  hump  and  a  moving  van  has  a  large 
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Figure  2.     Typical  VehicLe  Waveforms 


second  hump.  Thus,  there  is  a  possibility  of  classifying  by  counting  the  humps 
and  measuring  their  spacing  and  amplitude.     But,   another  problem  arises 
when  this  solution  is  considered.     If  we  look  carefully  at  the  waveforms  from 
the  dray  truck  and  the  step  van  in  Figure  2,  we  see  that  the  humps  are  an 
illusion.     The  second  hump  in  the  dray  truck  signal  is  actually  two  humps, 
one  small  and  the  other  larger.     The  first  hump  in  the  step  van  signal  is  real- 
ly three  humps.     Thus,  we  need  to  give  a  quantitative  definition  to  what  we 
mean  by  "hump"  since  eyesight  can  be  misleading  us. 

A  human  with  very  little  training,  can  rapidly  learn  to  distinguish  among  shapes 
like  those  shown  in  Figures  1  and  2  such  features  as  spacing,   size,  what  is 
meant  by  "hump,  "  and  the  ways  such  features  combine  in  different  objects, 
are  used  automatically.     But  a  machine  does  not  have  a  human  nervous  system 
and  it  does  not  have  the  training  that  a  human  has.     The  machine  must  start 
from  a  state  of  zero  knowledge  and  zero  background  and  it  must  be  provided 
with  everything  it  is  to  use  for  its  job.     Thus,   in  designing  a  classifier  to 
recognize  waveforms,  we  are  led  by  human  perception  to  choose  those  fea- 
tures or  characteristics  that  are  obvious  to  us.     We  then  find  out  how  these 
can  be  measured  or  represented  to  the  machine  and  what  rules  the  machine 
can  use  to  make  the  necessary  decisions.     These  steps,    (1)  define  features, 
(2)  measure  features,    (3)  define  rules,   (4)  apply  rules  to  make  decision,  are 
involved  in  designing  a  classifier.     The  preceding  discussion  of  the  vehicle 
waveforms  shows  some  of  the  main  considerations  involved  in  a  real  world 
problem. 

The  details  of  designing  the  bus  detector  classifier  are  discussed  later,  but  a 
brief  discussion  of  the  methods  used  will  help  in  understanding  the  more 
theoretical  discussions  that  follow.     The  humps  that  our  eyes  detect  in  the 
waveforms  are  the  main  features  that  were  used  in  the  classifier.     As  men- 
tioned above,  the  problem  in  using  theni  is  to  define  precisely  what  is  meant 
by  a  hump  and  to  do  so  in  a  way  that  can  be  tested  numerically.     The  obvious 
way  is  to  use  the  local  maxima  of  the  waveform,  but  this  has  the  problem 


discussed  earlier  that  there  are  many  small,   local  maxima  that  we  want  to 
ignore.     The  solution  to  this  problem  was  to  use  a  hysteresis  filter.     This 
smooths  out  the  small  variations  and  allows  the  machine  to  see  only  the 
broad,  relatively  large  peaks  that  we  see.     The  amplitude  and  spacing  of  the 
peaks  are  then  measured.     The  amplitude  is  received  directly  from  the  loop 
phase  detector  electronics  and  the  time  interval  between  successive  peaks 
is  read  from  a  digital  clock.     Since  we  are  measuring  broad  maxima  of  the 
signal,  the  precise  location  of  the  maximum  is  hard  to  determine  and  is 
sensitive  to  noise,  variations  in  the  vehicle  path,  and  other  disturbances. 
These  do  not  affect  the  amplitude  very  much,  but  they  do  cause  significant 
statistical  variations  in  the  time  measurements.     The  variations  make  it  . 
necessary  to  use  statistical  methods  in  making  the  decisions. 

In  general,  the  rule  about  three  peaks  characterizing  a  bus  is  true  for  most 
of  the  bus  waveforms  studied.     However,   if  we  look  back  at  Figure  1  we  see 
that  the  middle  peak  has  two  smaller  peaks  on  it.     The  hysteresis  filter  will 
merge  these  into  one  peak  if  they  are  small  enough,  but  for  some  busses 
these  peaks  are  quite  large  and  both  are  detected.     Rather  than  use  a  com- 
plex rule  that  sometimes  looks  for  three  peaks  and  sometimes  looks  for  four 
peaks,  the  feature  extraction  method  uses  only  the  first,   second  and  last  peaks 
of  any  signal.     This  causes  the  middle  peak  to  move  around  a  little,  but  this 
is  a  relatively  small  statistical  variation. 

Another  problem  that  was  encountered  in  the  bus  detector  is  that  different 
speeds  and  different  paths  over  the  detector  loop  cause  the  time  scale  and 
the  amplitude  scale  to  change.    A  fast  moving  vehicle  has  a  much  shorter 
signal  than  a  slow  moving  one  even  though  both  signals  have  the  same  shape. 
The  way  this  was  taken  care  of  was  to  normalize  the  amplitudes  by  using  ra- 
tios of  amplitudes  and  ratios  of  time  intervals.     The  features  thus  used  by  the 
classifier  are  the  peak  amplitudes  relative  to  the  first  peak  and  the  time 
intervals  relative  to  the  total  time  between  the  first  and  last  peaks.     One 
more  problem  that  bothered  the  orderly  design  process  was  that  vehicles  do 


not  always  keep  on  moving  until  they  have  completely  passed  over  the  loop. 
Sometimes  they  stop  causing  the  time  measurements  to  increase  and  the  ra- 
tios no  longer  are  characteristic  of  the  different  vehicle  types.     This  pro- 
blem was  handled  by  starting  the  classification  by  noting  how  long  the  vehicle 
took  to  cross  the  loop.     (Classification  does  not  start  until  the  vehicle  has  pas- 
sed. )    If  this  is  large  then  the  classifier  assumes  that  the  vehicle  has  stop- 
ped before  traveling  on  and  a  different  decision  rule  is  used  than  for  non- stop- 
ping vehicles. 

The  next  important  function  of  the  classifier  is  to  decide  whether  the  vehicle 
that  was  observed  was  a  bus.     A  human  uses  quite  subtle  and  sophisticated 
methods  of  recognizing  shapes,  but  the  methods  are  still  part  of  the  secret 
of  the  human  brain.     A  machine  has  to  use  simpler  methods  based  on  the  best 
information  that  it  can  measure.     The  preceding  discussion  leading  up  to  the 
definition  of  the  normalized  amplitude  and  time  interval  features  was  motivat- 
ed by  what  the  apparent  characteristics  of  the  signal  were.     If  the  peaks  are 
all  of  about  the  same  height  then  the  amplitude  ratios  will  all  be  near  unity, 
and  if  the  second  peak  is  near  the  middle  of  the  signal  then  the  two  ratios  will 
be  near  one -half.    Thus,   we  should  be  able  to  look  at  the  normalized  ampli- 
tudes and  times,   compare  them  to  the  values  one-half  and  one,   and  decide 
that  the  vehicle  was  a  bus  if  the  features  are  near  these  values.     Unfortunately, 
this  simple  and  obvious  solution  does  not  work. 

The  reason  that  the  simple  solution  fails  is  the  reason  that  statistical  methods 
are  used  to  find  the  decision  algorithm.     A  discussion  of  this  will  both  intro- 
duce the  ideas  behind  the  decision  algorithm  and  provide  motivation  for  the 
theoretical  discussions  to  come.     Figiire  3  illustrates  the  following  discussion. 
Figure  3a  shows  the  kind  of  waveforms  that  we  expect  from  "ideal"  busses 
and  semis.     The  time  intervals  between  peaks  and  the  amplitudes  of  the  peaks 
are  indicated.     For  an  approximately  ideal  bus  we  expect  t..   =  t~  and  a_  =  a 
-  a.        Figure  3b  gives  definitions  for  calculating  normalized  features.     These 
are  not  the  exact  definitions  used  in  the  bus  detector,  but  they  are  somewhat 
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simplified  for  this  discussion.     Figure  3c  lists  the  expected  feature  values 
for  the  ideal  bus  and  semi  waveforms  shown  in  3a  and  the  values  of  A    and 
TV  are  plotted  in  Figure  3d.     If  all  busses  were  identical  to  the  ideal  bus 
and  all  semis  were  identical  to  the  ideal  semi,   then  the  classification  algor- 
ithm would  only  have  to  determine  which  of  these  two  ideal  points  fit  the  mea- 
surements from  a  particular  vehicle.     But  real  world  data  is  not  ideal  and 
Figure  3e  shows  what  a  plot  of  real  world  data  is  likely  to  look  like. 

The  scatter  in  the  points  shown  is  from  many  sources.     Vehicles  change  speed 
while  they  are  crossing  over  the  loop  and  this  makes  the  time  intervals  differ 
from  the  ideal,   causing  scatter  in  the  T.  direction.     Different  makes  of  semi's 
and  busses  are  built  differently  and  this  causes  differences  in  the  amplitude 
of  the  peaks  which,    in  turn,   causes  scatter  in  the  A.,  direction.     Noise  in  the 
sensing  system  and  inaccuracy  in  precisely  locating  the  position  of  the  peaks 
cause  scatter  in  both  directions.     Because  of  the  scatter,  the  decision  has  to 
be  made,   not  by  comparing  with  a  single  reference  point  in  feature  space,   but 
by  comparing  with  a  reference  region.     Figure  3f  shows  two  regions  that  de- 
scribe the  distribution  of  the  bus  samples  and  the  semi  samples.     Given  an 
unknown  signal,   we  could  calculate  the  normalized  features  and  plot  them  on 
this  graph.     If  the  point  fell  inside  the  dashed  line  we  could  call  it  a  bus  and 
if  it  fell  inside  the  solid  line  we  could  call  it  a  semi.     However,   there  is  a 
part  of  the  plane  where  the  two  regions  overlap  and  there  is  no  obviously  best 
decision  for  points  that  fall  in  the  overlap  region.     The  theoretically  best  so- 
lution for  this  case  depends  on  knowing  the  statistical  distribution  of  the  scat- 
tering for  each  class  and  deriving  an  optimal  boundary  from  this  information. 
The  common  sense  solution  is  to  draw  a  line  through  the  middle  of  the  over- 
lap region  and  call  half  of  it  bus  and  other  half  semi.     For  cases  where  the 
points  can  be  plotted  on  graph  paper  the  common  sense  solution  will  usually 
give  as  good  a  result  as  the  optimal  solution. 

There  are  some  difficulties  with  the  solution  proposed  in  the  last  paragraph. 
First,    suppose  that  we  can  discover  data  clusters  that  can  be  described  by 


closed  curves  like  those  shown  in  Figure  3f.     It  is  quite  difficult  to  represent 
curves  other  than  circles  and  straight  lines  in  a  computer,    (not  impossible, 
just  difficult).     Second,  if  we  do  find  a  representation  of  a  complicated  curve 
it  is  usually  a  long,   complex  process  to  determine  whether  a  given  point  lies 
inside  or  outside  of  it.     Third,   real  world  data  do  not  often  fall  into  simple 
clusters  like  those  shown  in  Figure  3f,   and  when  they  do  it  is  usually  a  hard 
problem  just  to  find  where  the  clusters  are.     The  way  out  of  these  difficulties 
is  to  use  a  straight  line  to  separate  the  regions,    like  that  shown  in  Figure  3g. 

A  straight  line  is  easy  to  describe  in  a  computer,    it  is  easy  to  determine 
which  side  of  the  line  a  given  point  lies  on  and  for  many  types  of  problems 
the  straight  line  is  the  optimal  solution.     Besides  having  these  virtues,   any 
curve  that  might  be  used  to  divide  the  regions  can  be  approximated  as  closely 
as  desired  by  a  number  of  straight  line  segments  joined  end  to  end.     Thus, 
in  practice,    straight  lines  are  all  that  are  used. 

Before  leaving  this  example  let  us  consider  why  the  regions  for  different  types 
of  objects  should  overlap  and  what  can  be  done  about  it.     In  every  measurement 
process  there  is  a  certain  amount  of  noise  that  can  be  defined  as  the  unknown 
or  uncontrolled  or  unwanted  part  of  the  measurement.     In  a  classifier  the 
measurements  are  used  to  distinguish  between  different  things  and  as  long  as 
the  noise  is  small  compared  to  the  difference  that  is  being  tested,  then  the 
decision  can  be  made.     However,   if  the  noise  gets  larger  than  half  of  the  dif- 
ference between  the  two  way  to  overcome  this  problem  is  to  make  a  number 
of  independent  measurements.     This  can  be  done  in  two  different  ways.     If 
you  are  measuring  a  quantity  that  can  be  measured  more  than  once,  then  the 
different  measured  values  can  be  averaged  and  the  noise,   for  independent 
measurements,  will  be  reduced  by  the  square  root  of  the  number  of  values 
used.     But  this  will  not  work  for  the  bus  detector  because  each  vehicle  only 
passes  the  loop  once  and  the  decision  must  be  made  from  that  one  observa- 
tion.    It  is  still  possible  to  make  independent  measurements,  but  they  are 
measurements  of  different  characteristics  of  the  vehicle.     Thus,    in  the 
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example  in  Figure  3,  two  amplitudes  and  two  time  intervals  were  used.     In 
so  far  as  the  noise  in  each  of  these  measurements  is  independent  from  the 

noise  in  the  other  measurements  there  will  be  less  overlap  in  the  four  di- 

(1) 
mensional  space  than  there  is  in  any  of  the  single  measurements 

There  remains  one  classifier  function  that  must  be  discussed  -  vehicle  de- 
tection.    Before  measurements  can  be  made  on  the  vehicle  waveform,  the 
machine  must  know  that  a  vehicle  is  present  and  before  features  can  be  cal- 
culated and  used  to  classify  the  waveform,  the  machine  must  know  that  the 
vehicle  has  passed  and  all  the  information  has  been  obtained.     In  the  bus  de- 
tector,  vehicle  presence  is  determined  by  an  amplitude  threshold.     When  the 
phase  shift  becomes  larger  than  a  specified  amount,   the  machine  starts  mak- 
ing measurements  and  when  the  phase  shift  then  drops  below  the  threshold 
value  the  normalized  features  are  calculated  and  the  signal  is  classified. 
The  threshold  value  was  chosen  small  enough  to  detect  all  of  the  busses  and 
yet  large  enough  so  that  it  did  not  trigger  on  the  low  level  noise  output  from 
the  phase  detector. 


(1)  To  see  how  different  independent  measurements  help  reduce  overlap,   con- 
sider the  ideal  case  shown  in  Figure  3d  and  suppose  that  the  noise  in  measur- 
ing Ai  is  either  +0.  15  or  -0.  15  for  both  vehicle  types  and  the  noise  for  Ti  is 
either  +0.  1  or  -0.  1.     Thus  if  we  made  two  random  measurements  on  busses 
we  would  expect  to  get  the  two  different  values  Aj  =  0.  85  and  1.15  and  two  ob- 
servations of  semi's  would  give  A^  =  0.  55  and  0.  85.     This  is  a  50%  overlap 
on  this  one  measurement.     Similarly  there  is  a  50%  overlap  in  measurements 
of  Ti.     But  if  we  use  both  features  together,  then  in  four  observations  of  each 
vehicle  type  we  would  expect  to  get  the  pairs  of  values  shown: 

(0.  85,  0.4)  (0.  85,  0.4) 

,A        T   v    _    (0.85,  0.6)  (0.85,  0.2) 

1    1'       i;  (1.15,  0.4)  (0.55,  0.4) 

(1.  15,  0.6)  (0.55,  0.2) 

The  overlap  is  only  25%  in  this  case. 
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Figure  4  summarizes  the  functions  discussed  above  and  shows  how  they  are 
connected.    The  data  processing  flow  begins  with  the  digital  output  of  the 
phase  detector.    As  each  new  value  of  the  phase  is  generated  it  is  compared 
with  the  threshold  value  to  determine  whether  a  vehicle  is  present.     If  noth- 
ing is  happening,   (small  signal)  then  the  machine  waits  for  the  next  phase 
value  to  be  generated  by  the  phase  detector.     If  a  vehicle  is  present,   (large 
signal)  then  the  machine  notes  the  starting  time  and  checks  each  new  phase 
value  to  see  whether  it  is  a  signal  peak.     The  times  and  amplitudes  of  the 
peaks  are  saved.    While  it  is  looking  for  peaks  it  also  compares  the  phase 
values  with  an  "end  of  pass"  threshold  and  if  the  signal  is  smaller  than  this 
threshold  then  the  ending  time  is  stored  and  the  machine  proceeds  to  the  next 
stage  of  operation.     The  first  question  asked  by  the  machine  is  "Does  the  sig- 
nal have  3  or  more  peaks?".     If  not,  then  the  machine  declares  that  the  ve- 
hicle was  not  a  bus  and  it  goes  back  to  looking  for  the  next  vehicle.     If  there 
are  three  or  more  peaks  then  the  normalized  features  are  calculated  from  the 
raw  time  and  amplitude  measurements.     The  next  test  decides  whether  the 
vehicle  stopped  while  it  was  crossing  over  the  loop.    This  is  done  by  compar- 
ing the  total  time  of  vehicle  presence  with  the  nominal  value  of  15  seconds. 
If  the  vehicle  took  more  than  15  seconds  to  cross  the  loop  then  the  classifier 
treats  it  as  a  stopping  vehicle  and  if  less  than  15  seconds  it  assumes  the  ve- 
hicle was  moving  continuously  while  crossing  the  loop.     The  stopping  vehicles 
are  classified  by  using  only  the  normalized  peak  amplitudes  as  was  discussed 
earlier.     The  moving  vehicles  are  classified  by  using  both  the  normalized 
amplitudes  and  the  normalized  times.     In  either  case,  after  announcing  the 
decision,  bus  or  non-bus,  the  machine  then  returns  to  the  top  of  the  loop  and 
begins  looking  for  the  next  vehicle. 

The  discussion  in  this  chapter  has  covered  all  of  the  main  ideas  involved  in 
designing  a  classifier  that  can  distinguish  between  busses  and  other  kinds  of 
vehicles.     The  following  chapters  will  treat  these  same  ideas  in  more  general 
terms.     This  includes  discussion  of  the  statistical  and  geometric  concepts  that 
are  used  to  make  sense  out  of  the  multi-dimensional  data  that  is  used  to  design 
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the  classifier.     Finally,  the  computer  program  that  does  the  number  crunch- 
ing is  described.     Both  the  philosophy  and  the  operation  of  this  program  are 
treated  with  textbook  and  actual  examples. 


14 


CHAPTER   2 
CLASSIFIERS  AND  PATTERN  RECOGNITION 


WHAT  IS  PATTERN  RECOGNITION? 

The  idea  of  'pattern1  comes  from  human  perception.     From  the  time  of 
birth,   our  senses  are  bombarded  by  inputs  from  the  world  around  us.     We 
learn  to  sort  these  inputs  into  the  ones  with  meaning  and  the  meaningless 
ones.     We  further  learn  to  sort  the  meaningful  ones  into  those  we  should 
respond  to  and  those  we  can  ignore.     The  learning  continues  to  higher  and 
higher  levels  of  sophistication,   leading  to  language,  music,   mathematics 
and  other  subtle  thought  processes.     An  important  ability  that  helps  make 
all  of  this  possible  is  the  ability  to  recognize  that  something  being  exper- 
ienced right  now  is  similar  to  something  we  have  seen,  heard,  thought,   etc. 
before.     For  instance  we  recognize  a  truck  because  we  know  what  a  truck 
looks  or  sounds  or  smells  like.     The  things  we  call  'truck'  all  have  certain 
properties  in  common  that  make  them  like  each  other  and  different  from 
other  things  -  they  fit  the  pattern  that  we  have  for  trucks.     The  truck  pattern 
is  not  something  exact,  because  there  are  many  different  kinds  of  trucks  that 
fit  into  it.     It  would  be  very  hard  to  describe  the  pattern  we  use  to  recognize 
trucks,  because  almost  any  property  that  a  truck  has  can  also  be  found  in 
something  else.     (For  example:    trucks  carry  things,  but  so  do  wagons; 
trucks  have  motors,  but  so  do  cars;  trucks  are  bigger  than  cars,  but  so  are 
busses;  etc. ) 

This  may  sound  very  trivial,   until  you  try  to  build  a  machine  that  will 
recognize  trucks  automatically.     The  machine  must  have  a  detailed  descrip- 
tion of  the  pattern.     Pattern  recognition  theory  is  concerned  with  the  methods 
used  to  discover  the  detailed  pattern  descriptions  that  machines  can  use  to 
recognize  patterns. 
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It  will  be  worthwhile  to  dig  a  little  deeper  into  the  ideas  in  the  last  paragraph. 
It  is  clear  that  the  'truck  pattern'  is  not  itself  a  truck'.     Trucks  fit  the  pattern, 
but  the  pattern  is  not  a  truck.     Nor  is  the  pattern  a  collection  of  trucks  of 
various  kinds'.     There  is  an  abstract  thing  called  "the  set  of  all  trucks"  and 
the  things  we  call  trucks  are  the  things  in  this  set,  but  the  set  is  not  the 
pattern  either.     The  truck  pattern  is  the  criteria  or  descriptions  and  charac- 
teristics that  can  be  used  to  decide  whether  a  given  object  is  or  is  not  a  truck. 
Pattern  recognition  is  the  job  of  discovering  these  criteria. 

There  is  another  set  of  terminology  used  to  talk  about  these  matters.     The 
ideas  are  most  easy  to  discuss  using  the  pattern  idea,  but  to  talk  about  the 
machines  that  do  the  recognizing,   it  is  easier  to  use  the  terms  'class, 
classifier  and  classification'.     A  class  is  the  set  of  all    objects  that  match 
a  certain  pattern  -  like  the  set  of  all  trucks.     A  classifier  is  the  machine 
that  decides  whether  a  given  object  matches  the  pattern.     Classification  is 
work  that  the  object  recognizing  machine  does.     In  this  terminology,  pattern 
recognition  is  described  as  "classifier  design".     Depending  on  which  part 
of  the  classifier  design  problem  we  are  discussing,   it  will  be  simpler  to 
use  one  or  the  other  of  these  jargons.     Thus,   it  is  easier  to  say  "X  is  in  the 
truck  class"  than  "X  matches  the  pattern  called  'truck'",   even  though  the  two 
statements  have  the  same  meaning. 

A  word  of  caution  to  those  who  plan  to  read  some  of  the  references  on  pattern 
recognition.     Pattern  recognition  is  a  relatively  new  area  of  technology  and 
different  people  give  different  meanings  to  the  terms  defined  above.     Some 
of  the  more  theoretically  minded  workers  in  the  field  define  a  pattern  as  the 
representation  of  a  particular  observation  made  upon  an  object  (for  example, 
the  length,  width  and  color  of  a  given  object).     Observations  always  include 
noise,  thus  two  observations  of  the  same  object  will  yield  two  different 
patterns  for  the  object.     They  are  thus  lead  to  defining  a  "pattern  class" 
as  the  collection  of  different  patterns  that  come  from  different  observations 
of  one  kind  of  object.     Then  "pattern  recognition"  becomes  what  we  have 
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called  classification.     Another  group  uses  the  term  "pattern"  to  denote  the 
characteristics  by  which  an  object  can  be  recognized.     Thus  a  checkerboard 
has  a  square  pattern  and  a  backgammon  board  has  a  triangular  pattern.     The 
term  "taxonomy"  is  sometimes  used  in  place  of  "classification"  by  British 
authors  and  workers  in  biology  and  medicine.     It  is  therefore  worthwhile  to 
glance  through  the  preface  of  a  reference  book  to  learn  what  the  terms  mean 
to  the  author. 


SOME  HISTORICAL  BACKGROUND 

A  classifier's  job  is  to  make  a  decision  based  on  some  observed  character- 
istics of  an  object.     Before  the  computer  age,   all  but  the  simplest  decisions 
had  to  be  made  by  humans.     There  were  devices  like  burglar  alarms,  gover- 
nors,  light  switches  and  locks  that  could  make  some  very  simple  decisions, 
but  most  machines  worked  at  replacing  the  human's  muscles,   not  his  brain. 
Then  calculators  came  along  to  help  with  arithmetic  and  they  were  followed 
by  the  sophisticated  machines  we  call  computers.     The  first  computers  only 
tried  to  do  more  complex  mathematics.     However  it  was  found  that,   in  order 
to  do  the  complex  jobs,  they  had  to  be  able  to  select  among  alternative 
courses  of  action  based  on  the  results  of  the  calculations.     The  next  short  step 
was  to  use  this  ability  to  make  choices  the  main  job  and  the  mathematics 
secondary.     Thus  there  are  process  control  computers  today  that  do  logical 
and  input/output  operations  at  fantastic  speeds,  but  they  don't  even  have 
built-in  arithmetic. 

With  such  devices  available,  the  next  question  is  how  do  we  use  them?    What 
methods,   numerical,   logical  or  otherwise,   can  make  a  computer  perform  a 
complex  decision  task  like  recognizing  a  truck  or  understanding  a  spoken 
word?    The  answer,   of  course,   is  classifiers.     Does  this  mean  that  all  com- 
puterized methods   of  making  decisions  are  called  classification?    That  is 
exactly  what  it  means'.     Though  it  is  a  young  field,  pattern  recognition  theory 
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has  adopted  every  decision  making  method  it  could  find,   and  it  has  developed 
new  methods  where  it  could  not  find  old  ones  that  could  do  the  job. 

The  main  area  that  was  concerned  with  decisions  before  pattern  recognition 
came  into  being  was  the  branch  of  statistics  called  Statistical  Hypothesis 
Testing.     It  had  developed  rigorous  methods  for  choosing  among  alternatives 
on  the  basis  of  random  samples  and  assumptions  about  their  distributions. 
The  random  samples  are  numerical  values,   either  counts  or  measurements, 
and  the  decision  is  based  upon  how  well  the  value  matches  the  assumed 
distributions.     Early  pattern  recognition  methods  began  by  representing 
objects  bv  numerical  values  called  features.     These  were  chosen  so  as  to  be 
statistically  different  for  objects  from  the  different  classes  of  interest,    e.  g.  , 
the  weight  of  a  vehicle  will  separate  most  trucks  from  most  cars.    The  sta- 
tistical pattern  recognition  methods  are  very  successful  for  those  problems 
where  suitable  features  can  be  found  to  differentiate  between  the  classes. 
The  main  problem  is  then  to  discover  good  features  and  this  is  rarely  an  easy 
task.     Most  usually  there  is  no  single  measurement  that  will  do  the  job  and 
the  designer  must  try  combinations  of  many  measurements  in  order  to  find 
a  set  of  features  that  works.     It  was  during  the  "feature  selection"  stage  of 
its  development  that  pattern  recognition  got  a  reputation  of  being  an  art, 
rather  than  a  science.     Obvious  characteristics  like  shape  are  very  hard  to 
represent  numerically,    so  problems  like  recognizing  triangles  from  circles 
are  very  hard  when  only  statistical  methods  are  used. 


The  next  big  advance  in  pattern  recognition  methods  was  when  the  idea  of 
"structure"  was  introduced.     The  structure  of  an  object  can  be  described  by 
telling  what  its  parts  are  and  how  the  parts  are  put  together.     If  you  have  such 
a  description,  then  you  can  classify  an  unknown  object  by  comparing  its 
structure  with  the  descriptions  for  the  different  classes,   e.g.  ,   a  triangle 
has  three  straight  lines  as  its  circumference  and  they  are  joined  to  make  a 
closed  figure.     The  pattern  recognition  problem  then  became  to  define  the 


appropriate  parts,  discover  how  to  recognize  them  and  discover  the  proper 
ruLes  for  combining  parts  to  build  the  objects  of  interest.     In  those  probLems 
where  the  structural  method  is  useful,  the  choice  of  parts  is  usually  obvious 
and  they  are  normally  chosen  so  that  they  can  be  recognized  by  a  statistical 
classifier  or  by  template  matching.     Also,  the  rules  for  putting  the  parts 
together  is  usually  clear,   like  straight  line  segments  are  joined  end-to-end 
to  form  a  triangle.    However,  the  structural  method  is  not  the  universal 
solution.     It  has  its  problems  when  observational  noise  is  present.     The 
effects  of  noise  will  be  discussed  in  detail  when  the  Bus  Detector  is  described, 
but  some  appreciation  of  the  noise  problem  can  be  gotten  by  thinking  about  how 
to  recognize  free-hand  drawings  of  triangles  from  a  structural  description 
that  uses  "straight  line  segments." 

The  pattern  recognition  program  that  will  be  described  later  in  this  hand- 
book uses  a  combination  of  statistical  and  structural  methods. 


WHY  USE  CLASSIFIERS? 

Even  though  pattern  recognition  uses  the  methods  of  statistical  decision 
theory,   it  uses  them  in  a  somewhat  different  way  than  a  statistician  would. 
The  key  to  rigorous  use  of  statistical  methods  is  that  you  know  what  you  are 
measuring  and  you  carefully  define  the  experiment  before  you  make  any 
measurements'.     If  these  conditions  are  satisfied,  then  classical  statistical 
methods  are  the  best  way  to  make  a  decision.     In  the  problems  where  pattern 
recognition  is  useful,   one  or  both  of  these  conditions  cannot  be  filled.     The 
Bus  Detector  problem  is  a  good  example  of  this.     A  vehicle  crosses  a  detec- 
tor loop  buried  in  the  roadway.     This  produces  a  time-varying  signal.     The 
Bus  Detector  uses  this  signal  to  decide  whether  the  vehicle  is  an  urban  transit 
bus  or  some  other  kind  of  vehicle.     Why  not  use  statistical  decision  theory? 
First  -  each  time  a  vehicle  crosses  the  loop  we  are  performing  an  experi- 
ment over  which  we  have  almost  no  control'.     The  vehicle  can  be  moving  at 
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any  speed.     It  may  stop  over  the  loop  and  stay  there  for  an  unknown  length 
of  time.     There  may  be  two  vehicles  side-by- side  or  bumper- to-bumper,   etc. 
All  such  variations  introduce  parameters  that  have  to  be  identified  ahead  of 
time  and  estimated  during  the  experiment  if  the  statistical  method  is  to  be 
used.     Second  -  knowing  what  we  are  measuring  means  that  we  have  a  model, 
parametric  or  statistical,  that  relates  the  experiment  to  the  measurements. 
Even  if  we  could  control  the  vehicles,  it  would  be  impractical  to  develop  a 
numerical  model  of  how  each  kind  of  vehicle  affects  the  loop  under  different 
weather  and  load  conditions.    And  it  seems  obvious  that  a  closed  form  solu- 
tion (normal,  binomial,  etc. )  would  not  work.     Thus  we  are  led  to  seeking  a 
pattern  recognition  solution. 

How  does  pattern  recognition  get  around  these  problems?    The  statistical 
approach  is  to  control  the  experiment  and  treat  the  outcome  as  a  random 
variable.     The  pattern  recognition  approach  is  to  consider  the  experiment 
itself  as  a  random  variable.     It  assumes  that  a  "random"  sampling  of  experi- 
ments will  provide  enough  information  to  characterize  all  further  experiments 
and  that  conclusions  drawn  from  this  sample  will  also  be  valid.     The  sample 
experiments  are  called  the  "training  set".    In  the  case  of  the  Bus  Detector, 
a  loop  (like  the  one  used  in  the  street  installations)  was  installed  in  a  testing 
area  and  a  large  number  of  different  vehicles  were  driven  over  it.     These 
sample  experiments  included  busses,  trucks,  semi's, cars,  bikes,  etc. 
traveling  at  a  variety  of  speeds.     Some  of  them  stopped  over  the  loop,  others 
were  braking  or  accelerating  as  they  passed  over  the  loop.     We  tried  to  have 
the  test  vehicles  do  all  of  the  things  that  vehicles  on  the  street  might  do.     The 
data  base  thus  represents  or  implicitly  contains  a  numerical  model  of  how  the 
vehicles  affect  the  loop  under  a  wide  range  of  conditions.     The  pattern  recog- 
nition problem  is  to  discover  a  simple  numerical/logical  formula  for  this 
model  and  use  it  to  recognize  the  vehicles. 
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HOW  IS  A  CLASSIFIER  DESIGNED? 

To  answer  this  question  we  will  first  discuss  an  ideal  method  and  show  why 
it  is  impractical  and  then  discuss  a  practical  approximation  to  the  ideal. 
We  will  use  the  bus  detector  problem  as  described  in  Chapter  1  as  the  basis 
for  this  discussion  and  we  will  assume  that  a  sufficiently  large  number  of 
experimental  runs  have  been  performed  so  that  we  have  examples  of  all  the 
vehicle  types,   speeds  and  paths  that  will  be  found  in  practice.     Also  assume 
that  the  waveforms  from  these  experimental  runs  have  been  digitized  at  1/50 
second  intervals  (about  l-l/2*feet  of  vehicle  motion  at  60mphf.     This  data 
base  then  contains  or  represents  all  the  information  that  should  be  needed  to 
classify  these  vehicles. 

The  ideal  classification  method  is  known  as  a  "nearest  neighbor"  classifier. 
Call  the  digitized  experimental  waveforms  "prototypes."    Each  prototype 
represents  vehicle  type  X  traveling  at  speed  Y  crossing  the  loop  along  path  Z, 
The  sequence  of  digital  values  v..,  v2 ,  v„,    .  .  .  .  v     of  a  prototype  waveform 
are  a  function  of  the  conditions  X,   Y,   Z  for  the  experimental  run  that  pro- 
duced these  values.     Thus  we  can  formally  write; 

(vrv2,v3,  ...,vn)    =    f(X,Y,Z).  (1) 

The  basic  assumption  for  the  nearest  neighbor  classifier  is  that  this  function 
is  continuous  and  single  valued,    i.  e.  .,   small  changes  in  the  experimental 
conditions  produce  small  changes  in  the  waveform  and  different  conditions 
produce  different  waveforms.     If  this  is  true,  then  the  function  (1)  can  be 
inverted,   i.  e.  ,  there  is  a  function  F  such  that  the  conditions  can  be  deter- 
mined from  the  waveform; 

(X,Y.Z)    =    F(vrv2,v3,...,vn)  .  (2) 

*       1.5  ft. .  =  .1*6  m 

60  mph     =  96.6  kph 
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This  function  is  defined  as  follows:    Given  an  unknown  waveform  u^u^u^, .  .  .  , 
u   ,   compare  it  with  each  of  the  prototypes  and  find  the  prototype  to  which  it 
is  most  similar.     The  conditions  X,Y,  Z  that  produce  the  best  matching  pro- 
totype thus  identify  the  unknown.     [There  are  many  ways  to  do  the  waveform 

comparison.     Some  of  the  most  often  used  are:    (1)  sum  of  squares  of  differ- 

2  2 

ences  (Euclidean  distance),   E  -  (U--V-)     + +  (u  -v  )    ,     (2)  sum  of 

absolute  values  of  differences  (uniform  metric  or  cityblock  distance), 

E  =  |u1-v-  |+ +  |u  ~v    J  ,     (3)  maximum  absolute  difference  of  sample 

values,    E  =  max  (f  U..-V..  | ,  |u2-v2  | , ,  |u-v    f).    The  best  match  is  de- 
fined as  the  prototype  that  gives  the  smallest  error  E.  ]    If  the  experimental 
data  truly  represents  ail  the  conditions,  then  this  will  be  as  good  a  classifier 
as  can  be  found.     The  problem  with  this  classifier  is  the  large  amount  of 
computer  storage  and  computation  needed  to  implement  it.     A  good  estimate 
of  the  data  storage  needed  for  the  bus  classifier  is  50  vehicles  each  at  10 
different  speeds  along  5  different  paths  which  yields  2500  prototypes.     Each 
prototype  is  sampled  at  1/50  sec  intervals  for  50  seconds  (  to  accommodate 
vehicles  that  stop)  for  2500  sample  values  per  prototype.     This  requires 
6.  25  million  computer  words  to  store  the  prototypes.     To  compare  an  un- 
known against  all  of  the  prototypes  by  the  second  method  metioned  above  uses 
about  20  million  add  times.     Thus  a  very  large,  very  fast  computer  could 
classify  one  vehicle  every  five  to  ten  seconds.     Of  course  it  is  possible  to 
reduce  the  requirements  by  limiting  the  number  of  conditions  and  the  preci- 
sion of  the  classifier.     A  useable  set  might  be  20  vehicles,  five  paths,  five 
speeds,   1/10  sec  sample  interval  and  10-sec  long  signals.     This  gives 
50,000  storage  locations  for  the  prototypes  and  150,  000  operations  per  deci- 
sion.    A  good  mini- computer  like  the  IMP- 16  would  be  able  to  do  this  in 
about  0.  3  second  per  vehicle.     If  we  allow  1/2  second  spacing  between  vehicles 
(six  foot  spacing  at  8mph)  then  one  IMP- 16  could  handle  one  lane  of  traffic 
and  it  would  probably  take  three  microprocessors  like  the  8080  operating  in 
parallel  for  each  traffic  lane.     These  reasons,   storage  and  time,   are  why 
the  nearest  neighbor  approach  is  called  impractical  for  this  problem. 
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Before  totally  dropping  the  nearest  neighbor  method  we  shouLd  see  if  there 
are  some  simple  changes  that  might  make  it  practical.     In  the  example  shown 
in  Figure  3  we  used  normalized  time  and  amplitude  values  as  features.     This 
normalization  removes  most  of  the  effects  of  different  speeds  and  paths  and 
would  thus  reduce  the  number  of  prototypes  needed.     Also,   if  the  prototypes 
are  represented  by  just  the  peak  values  and  times,  then  the  amount  of  storage 
needed  for  each  prototype  is  only  six  numbers,   (two  time  ratios,  two  ampli- 
tude ratios,  total  time  -  to  be  used  for  the  stopped  vehicle  test  and  the  class). 
If  20  prototypes  were  enough  then  very  little  storage  is  needed  and  the  com- 
putation time  is  reduced  to  less  than  ten  milliseconds  for  the  IMP- 16.      How- 
ever, there  is  a  problem  with  this  solution.     In  this  discussion  of  the  nearest 
neighbor  method  we  have  ignored  random  variations  and  noise.     During  the 
data  collection  for  the  bus  classifier  design  experiments  were  done  where  a 
single  vehicle  drove  over  the  loop  a  number  of  times.     The  driver  was  told 
to  travel  at  the  same  speed  and  follow  the  same  path  each  time.     When  the 
normalized  features  for  these  runs  are  compared  with  each  other  and  with 
runs  made  by  other  vehicles,  there  is  as  much  variation  among  the  presumably 
identical  runs  as  there  is  between  them  and  runs  by  other  kinds  of  vehicles. 
This  only  shows  that  the  modified  nearest  neighbor  classifier  would  need 
more  than  just  one  prototype  per  vehicle  class.     The  number  of  prototypes 
needed  more  like  40  to  60  to  accurately  distinguish  between  busses  and  all 
other  types  of  vehicles.     With  this  estimate  it  still  looks  like  one  IMP- 16 
could  do  the  classifying  for  an  eight  lane  intersection,  but  there  would  not  be 
much  time  left  over  for  other  activities. 

The  defining  characteristic  of  the  nearest  neighbor  method  is  that  it  repre- 
sents a  class  by  remembering  particular  examples  that  belong  to  the  class. 
This  kind  of  representation  can  be  very  complex,   as  the  discussion  above 
indicates.     The  example  shown  in  Figure  3  showed  how  straight  lines  could 
be  used  to  simplify  the  class  description  when  there  are  only  two  features. 
To  describe  or  define  the  bus  and  semi  regions  shown  in  Figure  3f  would 
require  about  20  prototypes,  assuming  sample  points  are  used  as  the 
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prototypes,   and  there  would  still  be  confusion  in  the  overlapping  region. 
The  single  straight  line  shown  in  Figure  3g  separates  the  space  into  two 
regions  in  a  much  simpler  way  and  it  does  so  with  only  six  errors.     Since 
there  is  a  region  in  the  plane  where  we  do  not  know  whether  the  points  are 
in  one  class  or  the  other,  any  decision  rule  that  classifies  points  in  this 
region  will  be  open  to  question.     Without  further  information  we  cannot  say 
whether  the  straight  line  classifier  (that  makes  certain    errors)  or  the  near- 
est neighbor  classifier  (that  retains  the  confusion)  is  closer  to  the  real  world. 
However,  for  both  philosophical  and  practical  reasons,  when  two  descriptions 
are  equally  possible,   it  is  best  to  choose  the  simpler  one.     For  this  reason 
the  straight  line  division  is  preferred.     The  straight  line  can  be  defined  by 
only  two  parameters  by  the  equation 

aAj  +bTj    =    1  (3) 

where  A.,  and  T1  are  the  feature  values  and  a    and  b  are  the  parameters. 
This  is  in  contrast  to  the  40  parameters  (two  coordinates  for  each  of  20  points) 
that  the  nearest  neighbor  description  requires.     Similarly,  to  decide,  by  the 
nearest  neighbor  method,    which  class  an  unknown  point  with  features  A-,   T1 
belongs  to  requires  calculating  20  expressions  of  the  form  |  A--A.  |  +  |T..-T.  [ 
and  comparing  their  values  to  determine  which  one  was  the  smallest.     By  the 
straight  line  method  the  class  is  determined  by  calculating  the  value  x=aA+bT-l. 
If  x  <  0  then  the  point  is  on  the  bus  side  of  the  line  and  for  x  >  0  the  point  is 
on  the  semi  side  of  the  line,     (x  =  0  for  points  on  the  line.) 

The  expression  aA-+bT1  -  1  is  called  a  "Linear  Discriminant  Function." 
It  discriminates  between  points  in  the  two  classes  by  being  positive  in  the 
region  belonging  to  one  of  the  classes  and  negative  in  the  region  of  the  other 
class.     If  we  used  all  four  of  the  normalized  features  then  a  linear  discriminant 
function  of  these  four  variables  will  have  the  form 

pA1+qA2+rT1+sT2-l    =    D(Ar  A2,  T±,  Tg)  .  (4) 
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The  equation 

D(ArA2,TrT2)  =  0  (5) 

is  the  equation  for  a  "hyperplane"  in  the  four  dimensional  space.     One  of  the 
complications  that  comes  with  using  more  than  two  features  is  that  the  points 
cannot  be  plotted  on  graph  paper.     (K&E  has  graph  paper  that  can  be  used  to 
plot  points  in  three  dimensions  but  four  dimensional  graph  paper  has  not  been 
tried  yet.)     Even  though  we  cannot  plot  points  in  these  higher  dimensional 
spaces,  we  can  and  do  still  use  geometric  concepts  and  terms  to  discuss  and 
solve  pattern  recognition  problems.     Thus  in  three  dimensions  a  linear  dis- 
criminant defines  a  plane,    in  four  dimensions  it  defines  a  hyperplane.     We 
talk  about  the  two  sides  of  a  line  or  two  sides  of  a  plane  -  in  each  case  the 
negative  side  contains  the  origin  [x(0,0)    =    a'O+b-0-1  =  -1  in  two  dimensions] 
and  the  other  side  is  the  side  away  from  the  origin.     Similarly,   in  four  dimen- 
sion we  can  talk  about  the  two  sides  of  a  hyperplane.     A  hyperplane  divides 
the  four  dimensional  space  into  two  parts,   one  of  which  contains  the  origin 
and  the  other  part  does  not. 

To  separate  two  classes  in  four  dimensional  space  we  have  to  find  a  hyper- 
plane that  dives  the  two  classes  like  the  line  does  in  Figure  3g.     The  formulas 
for  doing  this  are  in  the  CTC  program  and  the  method  is  explained  in  detail 
in  Chapter  3.     The  ideas  behind  the  mathematical  method  are  quite  simple. 
To  discuss  them  we  need  another  analog  to  a  line  in  two  dimensions.     The 
notation  using  the  normalized  bus  detector  features  A- , .  .  .  ,  T2  is  a  little  bit 
clumsy  for  this  discussion  so  we  will  use  the  more  familiar  symbols  (x,y) 
for  the  coordinates  of  a  point  in  two  dimensional  space  and  (x,y,  z,w)  for 
four  dimensions.     A  line  in  two  dimensions  is  then  given  by  the  equation 

ax  +  by  -  1    =    0  (6) 
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and  a  hyperplane  is  given  by 

ax  +  by  +  cz  +  dw  -  1    =    0  (7) 

The  corresponding  Linear  discriminant  functions  are 

i 
D2(x,y)    =    ax  +  by  -  1    and    D.(x,y,  z,w)    =    ax  +  by  +  cz  +  dw  -  1 

(8) 

where  the  subscripts  indicate  the  dimension  of  the  space.     As  before,  the 
equations  for  the  line  and  the  hyperpLane  are 

D2(x,y)    =    0         and     D4(x,y,z,w)    =    0  (9) 

respectively.     These  two  functions  are  really  normalized  distance  functions 
whose  unit  of  measurement  is  the  distance  from  the  line  (or  hyperplane)  to 
the  origin.     To  justify  this  interpretation,  note  that  the  distance  from  the 
line  to  any  point  on  the  line  is  zero,   and  for  any  point  (x,y)  on  the  line 
D2(x,y)    =    0.     Similarly  for  the  hyperplane.     Also,  the  value  of  the  discrimi- 
nant function  at  the  origin  (0,0)  is  D„(0,  0)  =  -1  (one  unit  in  the  negative 
direction)  and  similarly  for  the  hyperplane.     Thus,   if  we  have  a  discriminant 
function,  whether  it  be  in  two  dimensions  or  in  four  dimensions,  the  values 
of  the  function  are  simply  distances  relative  to  the  location  of  the  line  or 
hyperplane.     Distances  can  be  plotted  very  easily  on  graph  paper  or  they  can 
be  listed  in  a  table.     Either  way,  by  using  the  discriminant  function  values 
for  the  sample  points  we  can  "see"  exactly  how  the  sample  points  are  located 
in  the  space,  whether  it  is  a  two  dimensional  space  or  a  four  dimensional 
space.     (In  the  CTC  program  these  are  called  "tradeoff"  listings,) 

We  will  next  consider  how  these  distance  plots  will  help  to  design  a  classifier. 
The  discussion  applies  to  any  number   of  dimensions  (CTC  can  handle  up  to 
ten  dimensions)  so  we  will  drop  the  terms  line  and  hyperplane  and  use  the  term 
"boundary"  for  the  surface  defined  by  the  discriminant  function.     Suppose  we 
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are  given  a  set  of  points  representing  samples  from  two  different  classes. 
Call  these  points  P-,  P2,:P3'  -  •  •  •  p   •     We  wil1  name  the  classes  "1"  and  "2" 
rather  than  bus,    semi,   etc.     Next,   define  a  new  function,   called  the  class 
function  C(P),  by 

C(P)    =    1    if    P    is  in  class  1,   C(P)    =    2    if    P    is  in  class  2      (10) 

and  let  C-  =  C(P).     If  we  could  find  a  formula  for  the  class  function  then  the 
classifier  design  would  be  done,  because  to  classify  any  point  P  we  would 
only  have  to  calculate  the  value  C(P)  of  the  class  function  and  that  would  be 
the  class  name.     The  problem  with  trying  to  do  this  is  that  the  class  function 
only  defined  at  the  sample  points  P.  and  we  would  like  to  be  able  to  classify 
other  points  that  we  have  not  seen  before.     One  way  to  do  this  is  to  treat  the 
problem  of  classifying  the  unknown  points  as  a  problem  of  interpolating 
between  the  known  points  to  find  the  values  at  the  unknown  points.     In  particu- 
lar,  linear  interpolation  would  be  very  nice  because  linear  functions  are  so 
easy  to  compute.     So,  for  the  purpose  of  discussion,   let  us  assume  that  we 
can  find  a  linear  interpolating  function  L(P)  that  either  fits  the  known  sample 
points  P.  exactly  [i.  e.  ,   L(P.)  =  C]  or,   if  an  exact  fit  is  not  possible,  then 
one  that  fits  the  known  sample  points  approximately  [i.  e. ,   L(P-)  «  C], 
Since  the  interpolating  function  is  continuous,  there  will  be  points  where  it 
has  values  other  than  1  and  2.     For  example,   suppose  L(P.)  =  1  and  L(P.)  =  2, 
then,  for  the  point  P  =  P.+P./2  that  lies  halfway  between  P.  and  P.,  we  will 
find  L(P)  =  1.  5  because  of  the  linear  properties.     Now,   suppose  that  by  some 
act  of  providence  all  of  the  known  points  in  class  1  are  close  to  each  other  and 
all  the  known  points  in  class  2  are  close  to  each  other  and  that  class  1  and 
class  2  are  far  apart.     (If  this  is  true  then  we  say  that  the  known  sample 
points  are  "clustered"  and  the  classes  are  "widely  separated.")    Since  the 
known  points  in  class  1  are  clustered,  we  would  expect  that  any  new,   unknown 
point  belonging  to  class  1  will  either  lie  inside  the  cluster  or  close  to  it. 
Therefore  the  interpolating  function  will  have  values  close  to  1  for  all  points 
in  class  1.     Similarly  the  interpolating  function  will  have  values  close  to  2 
for  points  in  class  2.     Thus  we  could  define  a  classification  rule 

27 


"assign  P  to  ciass  1  if  L(P)  <  1.  5  and 

(11) 

assign  P  to  class  2  if  L(P)  >  1.  5"     . 

There  is  a  very  simple  relationship  between  this  interpolating  function  L(P) 
and  the  linear  discriminant  function  D(P)  discussed  earlier; 

D(P)    =    -{'UP)-  1.5}/{L(0)-  1.5}  (12) 

where  0  denotes  the  origin.     We  thus  see  that  the  boundary  D(P)  =  0  deter- 
mined by  this  method  lies  halfway  between  the  two  clusters,   since  L(P)  =  1.5 
happens  for  points  that  are  halfway  between. 

Of  course  we  cannot  expect  that  the  points  obtained  by  real  world  experiments 
will  always  form  nice  clusters.     Instead  we  expect  experimental  data  to  be 
scattered  and  have  overlapping  class  regions  as  in  Figure  3.     But  the  inter- 
polating function  idea  still  works  in  these  situations.     Regardless  of  how 
badly  scattered  or  overlapped  the  experimental  classes  are,  the  interpolating 
function  will  still  be  approximately  1  for  class  1  and  approximately  2  for 
points  in  class  2  and  the  boundary  L(P)  =  1.5  will  still  split  the  space  into 
two  parts.     The  difference  in  this  case  is  that  the  interpolating  function  does 
not  match  the  class  function  as  well  and  there  are  experimental  points  that 
lie  on  the  wrong  side  of  the  boundary  and  are  thus  mis- classified.     But  we 
do  not  really  care  how  closely  the  interpolating  function  fits  the  class  function 
the  important  thing  is  how  well  the  points  are  classified,   i.  e.  ,  how  well  the 
boundary  separates  the  classes'.     As  we  discussed  earlier,  when  the  experi- 
mental points  are  in  overlapping  regions  then  the  classifier  will  probably 
make  some  mistakes  just  because  of  the  way  the  classes  are  defined  by  the 
experimental  data.     In  such  cases,  a  rational  course  of  action  is  to  attempt 
to  minimize  the  errors  without  making  the  solution  any  more  complex  than 
can  be  justified  by  problem  and  the  data. 
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The  preceding  discussion  assumed  that  a  Linear  interpolating  function  could 
be  found.     Next  we  will  look  at  how  to  find  such  a  function.     For  this  discus- 
sion we  will  go  back  to  the  notation  in  Equation  (8).     Let  the  sample  points 
P.,   L=l, ...  ,  n  have  the  coordinates  P.=(x.,y.,  z.-,  w.)  and  let  a,b,  c,  d,  e  be  the 
coefficients  of  the  interpolating  function; 

L(P.)    =    ax.  +by.  +  cz.  +  dw.  +  e  .  (13) 

The  class  function  values  C.  =  1  or  2  are  the  ideal  values  for  L(P.).     We  can 
write  this  ideal  condition  as 


ax-  +  by-  +  cz1  +  dw..  +  e    =    C. 
ax2  +  by2  +  cz„  +  dw2  +  e    =    C2 

(14) 


ax_  +  by    +  cz     +  dw     +  e    =    C 
n        Jn  n  n  n 

If  there  are  only  five  sample  points  then  we  will  have  a  system  of  five  equa- 
tions in  five  unknowns  a,b,c,d,  e  and,   except  for  certain  singular  cases,  the 
equations  will  have  a  solution.     In  general  we  want  and  will  have  many  more 
than  this  minimum  number.     In  that  case  the  coefficients  are  found  by  the 
least  squares  method.     Define 

2  2 

E    =    (axi+byi+cz1+dw-+e-Ci)   +.  .  .  +(ax  -fby  +cz   +dw  +e-C  )    . 
1     J 1        1         1  1  n     Jn       n        n  n 


(15) 


Each  of  the  squared  terms  is  the  difference  or  error  between  the  value  of 
the  interpolating  function  and  the  desired  value.  The  best  solution  for  the 
coefficients  a, .  .  .  ,  e  would  make  each  of  these  errors  equal  to  zero  and  if 
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that  is  not  possible  then  the  next  best  is  to  make  the  sura  of  squared  errors 
(15)  as  small  as  possible.  We  can  find  the  values  of  a, .  . .  ,  e  that  minimize 
E(a,  .  .  .  ,  e)  by  solving  the  set  of  linear  equations  shown  below: 


BE 
da    " 

0 

dE 
db 

0 

dE 
dc 

0 

dE 
dd 

0 

dE 

n 

(16) 
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It  is  not  necessary,  for  the  present  discussion,  to  deal  with  the  way  these 
can  be  solved.     The  CTC  program  does  the  solution  in  what  is  called  the 
method  1  classifier,   so  we  will  let  the  matter  rest. 

Once  the  coefficients  are  known,  the  decision  rule  can  be  implemented  by 
Equation  (11)  and  the  classifier  design  is  finished.     This  procedure  yields  a 
two  class  classifier  that  is  close  but  not  perfect.     There  are  a  number  of 
simple  ways  to  use  this  classifier  as  an  initial  approximation  and,  by  modify- 
ing the  coefficients,   obtain  better  performance.     These  methods  are  discussed 
in  Chapter  3. 


MULTICLASS  CLASSIFIERS 

The  final  topic  for  this  chapter  is  "multi-class  classifiers.  "    So  far  we  have 
only  talked  about  separating  or  distinguishing  between  two  classes  of  objects, 
like  bus  versus  semi  or  bus  versus  not-bus.     The  bus  detector  classification 
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is  stated  as  a  two  class  problem  -  "Recognize  busses  and  reject  everything 
else"  -  so  it  is  natural  to  think  that  it  can  be  solved  as  a  two  class  problem 
using  the  method  given  above.     But  this  is  not  the  case.     The  "class"    of 
vehicles  denoted  by  the  term  "not- bus"  is  built  up  from  the  classes  known  as 
"truck,"  "semi,"  "moving  van,"  "school  bus,"  "VW,"  "Torino,"  "motor 
cycle,"  "Step  Van"  and  on  and  on.     Their  only  points  of  similarity  are  that  they 
are  all  motorized  vehicles  and  they  are  all  not-busses.     If  we  had  a  sensor 
that  could  measure  a  feature  called  "busness"  then  we  would  have  a  reason 
to  think  that  there  is  a  natural  reason  for  defining  a  natural  not-bus  class. 
But  the  sensor  we  are  using  does  not  measure  "busness,"  it  measures  a 
physical  quantity  related  to  the  structure  of  the  vehicles  it  is  sensing.     The 
natural  way  to  define  classes  relative  to  this  sensor  is  to  group  vehicles  that 
have  similar  measurements  into  a  class  and  require  that  if  two  vehicles  have 
different  measurements  they  must  be  placed  into  different  classes.     (This  is 
the  reason  that  "clusters"  of  points  were  talked  about  earlier. )    Therefore 
if  we  put  vehicles  with  similar  structures  together  in  classes  we  will  have 
a  multi-class  problem  involving  "bus,"  "truck,"  "semi,"  etc.   rather  than 
a  two  class  problem. 

In  designing  the  bus  detector  classifier  we  found  that  busses  from  different 
manufacturers  formed  separate  clusters  and  that  it  was  even  possible  to 
distinguish  between  different  model  years  of  the  same  make.     In  working  a 
classifier  problem  it  is  generally  a  good  idea  to  keep  all  of  the  distinctions 
by  defining  different  classes  for  each  distinguishable  kind  of  object.     Thus 
in  the  bus  detector  data  base  the  vehicles  are  labeled  as  "bus  1,"  "bus  2," 
"bus  3,"  "truck,"  "semi,"  etc.     Furthermore  the  moving  and  stopped 
vehicles  were  labeled  separately  so  that  we  had  "bus  1  -  moving,  "  "bus  1  - 
stopped,"  etc.   as  the  predefined  classes.     With  these  a  priori  distinctions 
included  in  the  data  it  is  then  easy  to  combine  small  classes  into  larger  ones 
if  the  analysis  shows  that  they  are  similar  in  terms  of  the  feature  values. 
The  opposite,  finding  separate  clusters  in  data  that  is  labeled  the  same,   is  a 
very  difficult  problem  and  should  be  avoided  when  possible. 
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Thus  we  see  that  the  multi- class  problem  is  the  rule  and  the  two  class  prob- 
lem is  the  exception.     Fortunately  a  multi- class  problem  can  be  solved  as  a 
sequence  of  two  class  problems,   as  shown  by  the  following  example:    suppose 
we  have  three  classes  of  objects,   call  the  classes  A,B,C.     Further  suppose 
that  we  have  three  classifiers  K  ,  ,K     ,  K,      each  of  which  is  a  two  class 
classifier  that  can  distinguish  between  objects  in  the  classes  indicated  by  the 
subscripts.     Then  for  an  object  that  is  in  either  A  or  B  classifier  K  ,    will 
make  the  correct  decision,  but  for  an  object  in  C  classifier  K  ,    may  be  right 
or  it  may  be  wrong  -  we  write  this  as  K  h(A)  =  A,  K  h(B)  =  B,  K  h(C)  =  ?. 
Now  suppose  that  we  have  an  object  x  whose  class  is  unknown.     We  can  use 
each  of  the  classifiers  to  classify  the  x,   even  though  we  do  not  know  which 
ones  will  give  the  right  answer.     What  we  do  know  is  that  two  of  the  classi- 
fiers will  be  right  and  the  third  one  may  be  right  and  it  may  be  wrong.     Thus 
we  can  find  the  right  answer  simply  by  taking  a  majority  vote  of  the  three 
classifiers. 

The  majority  vote  method  of  combining  two  class  decisions  to  make  a  multi- 
class  decision  is  a  sufficient  solution  to  the  problem,  that  is,   it  will  do  the 
job  but  we  may  be  able  to  get  by  with  a  simpler  method.     The  bus  detector 
shows  why  it  may  be  desirable  to  look  for  an  easier  or  simpler  way.     For 
the  bus  detector  design  we  considered  20  vehicle  classes  at  the  start.     This 
included  six  bus  classes  (three  different  busses,   moving  and  stopped)  and 
fourteen  others  (seven  vehicle  types,   moving  and  stopped).     By  the  majority 
vote  method  we  would  have  to  classify  all  possible  pairs  of  classes  and  this 
would  require  (20)(19)/2  =  190  two  class  decisions'.      There  must  be  a  better 
way.     And  there  is.     For  the  bus  detector  we  start  by  first  deciding  whether 
the  vehicle  was  moving  or  had  stopped.     These  two  cases  are  then  treated 
by  separate  classifiers.     Potentially,   each  of  these  classifiers  would  have 
to  consider  45  two  class  decisions  (possible  pairs  of  ten  vehicle  types). 
While  this  would  be  a  saving  over  the  190  pairs  discussed  above,   it  was 
possible  to  simplify  the  solution  even  more.     For  moving  vehicles  it  was 
found  that  the  semi's  and  moving  vans  could  be  distinguished,  as  a  class, 
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from  all  the  other  vehicles.     (This  might  be  expected  because  of  the  number 
of  axles.)    It  was  also  found  that  the  semi's,  moving  vans  and  busses  could 
be  grouped  together  into  a  class  and  this  class  could  be  distinguished  from 
the  remaining  vehicles.     (Again  this  might  be  expected  on  the  basis  of  vehicle 
size.)    We  were  thus  able  to  construct  two  classifiers: 

K1 :    Two  axle  versus  three  axle 

K?:    Large  vehicle  versus  small  vehicle 

The  final  classifier  then  combines  these  two  decisions  and  defines  a  bus  as 
a  "large,  two-axle  vehicle."    A  similar  separation  was  possible  for  the 
stopped  vehicles.     (Actually  the  pairwise  separations  indicated  above  were 
not  perfect,  but  the  classifiers,  when  combined,   identified  the  busses 
correctly. ) 

With  this  introduction  to  the  problems  and  methods  of  classifier  design 
finished,  we  will  next  consider  a  simple  numerical  example  to  show  the 
methods  in  action.     The  problem  of  designing  the  bus  detector/classifier  is 
taken  up  again  in  Chapter  6. 
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CHAPTER  3 
EXAMPLES  OF  CLASSIFYING  MULTIDIMENSIONAL  DATA 


3.  1    INTRODUCTION 

To  consider  interactive  approaches  to  classifier  design  we  must  first  discuss 
some  properties  of  sample  data  distributions  and  how  they  are  used  in  classi- 
fier design.     We  also  need  some  ideas  involving  linear  (or  piecewise  linear) 
discriminants  and  how  they  are  used  to  partition  the  feature  space. 

In  this  chapter,  the  necessary  properties  of  sample  data  distributions  are 
discussed  and  numerical  examples  of  the  linear,  piecewise  linear,  and  layered 
machine  classifiers  given.     This  will  provide  the  background  for  using  inter- 
active techniques  and  for  using  the  Cascaded  Threshold  Classifier  (CTC) 
program. 


3.2    SAMPLE  DATA  DISTRIBUTIONS 

For  most  problems  appropriate  for  classifier  solutions,  the  probability 
distribution  from  which  the  experimental  data  are  drawn  is  unknown.     Only 
the  class  membership  for  each  data  point  is  known.     Thus,  one  must  make 
assumptions  concerning  the  underlying  probability  distribution  using  properties 
of  the  sample  data  distribution  to  justify  these  assumptions.     The  assumptions 
are  then  used  to  guide  the  classifier  design  process. 

The  most  common  assumption  is  that  the  probability  density  for  each  pattern 
class  is  Gaussian,     The  distribution  function  for  class  C.  is  then  given  by: 

1/2  T    -1 

P(X|a)    -     [(2n)ndet  Vx  /]        exp[-|-  (X-rau)    Vx  ^X-m.)]  (17) 
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where  m.  is  the  mean  and  Vv  .  is  the  covariance  of  C-.     These  are  estimated 

l  .A,  1  L 

from  the  experimental  data  by  the  formulas: 

M. 


m- 
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The  linear  discriminant  (see  Subsection  3.  3.  1  and  Appendix  A)  can  be  shown 
to  be  the  optimal  means  of  deciding  between  two  classes  C,  and  Cr,  each 
having  the  density  given  in  Equation  (17),  but  with  unequal  mean  vectors. 
In  two  dimensions,  the   linear  discriminant  is  a  line  and,   in  three  dimensions, 
it  is  a  plane.     In  any  case,  the  linear  discriminant  separates  the  feature 
space  into  two  parts.     One  part  contains  the  points  most  likely  belonging  to 
class  C. ,  the  other  to  C2.     To  classify  a  sample,  the  classifier  determines 
on  which  side  of  the  discriminant  the  data  point  lies. 

A  common  approach  to  classifier  design  is  to  assume  that  all  classes  are 
described  by  unimodal  Gaussian  densities  as  in  Equation  (17),  and  then  use  the 
data  to  compute  coefficients  for  the  linear  discriminants  between  each  pair  of 
classes.     The  unimodal  assumption  can  be  weakened  to  include  multi- modal 
classes  described  by  the  density  (mixture  density) 

P(X|C.)    =     S      P.    .  P(X|C.    ,),     P. .  =   S  P. "      <  1  ,  (19) 

t  =  ±         >  '  ^  t        ' 

where  each  P(X/C    „)  can  be  expressed  as  in  Equation  (17).     The  solution, 

for  classification,   is  to  split  each  such  class  (multi- modal  class)  into  the 

appropriate  Kp-  sub-classes,   extending  the  original  N  class  problem  to  an 

.      N 
an  N  =E    Kq.  class  problem,   and  use  linear  discriminants.     The  original 

i=l         l 
N  class  problem  is  then  solved  by  piecewise  linear  discriminants.     This  use 

of  subclasses  is  further  explained  in  this  subsection,  and   Subsections  3.  3  and 
3"5-  35 


The  validity  of  the  unimodal  gaussian  assumption  or  the  multimodal 
gaussian  assumption  rests  upon  the  following  two  properties: 

1.  Complexity  -  the  complexity  of  a  sample  data  distribution 
comes  from  two  sources:    a)  inter-class  complexity;  and 
b)  intra- class  complexity.     Loosely  speaking,   inter- class 
complexity  is  related  to  how  classes  overlap  and  the  shape 
of  the  overlap  regions.     Intra- class  complexity  is  related 
to  the  shape  and  modality  of  a  class.     Intra-  and  inter- class 
complexity  are  not  independent  of  one- another  in  their 
effects  on  classifier  design. 

2.  Dimensionality  -  Experimental  data  are  used  to  design 
classifiers,  but  the  raw  data  are  usually  transformed 
before  they  are  used  for  classification.     While  the  raw 
data  values  (measurements)  may  be  mutually  independent, 
the  transformed  values  (features)  may  be  mutually 
dependent.     If  the  features  are  dependent,  then  they  lie 

in  a  lower  dimension  sub- space  and  the  distribution  is 
not  gaussian.     Intermediate  between  independent  and 
dependent  features  is  the  general  case  of  correlated 
features,  where  the  correlation  lies  between  zero  and 
unity  in  magnitude.     If  the  correlation  is  near  unity,   or 
if  the  lack  of  correlation  is  due  only  to  noise,  then  it 
is  often  advisable  to  remove  one  or  more  of  the  correlated 
features  so  as  to  make  the  data  distribution  more  like  a 
gaussian  distribution. 

To  aid  in  discussing  complexity,   consider  the  sample  distribution  shown  in 
Figure  5a. 
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Figure  5a.     Example  of  Low  Complexity  Distribution 

Figure  5a,   classes  I,  II  and  III,  are  examples  of  distributions  with  low 
complexity  relative  to  a  linear  classifier.     That  is,  they  are  approximately 
gaussian.     The  'ball-like1  cluster  of  data  points  for  each  class  conforms  to 
the  distribution  one  would  expect  for  a  class  with  a  unimodal  gaussian  density; 
thus  low  intra- class  complexity. 

Further,  there  is  little  overlap  between  the  classes,  hence  there  is  a  low 
inter- class  complexity.     Figure  5a,   classes  I  and  II,   illustrates  the  analogous 
low- complexity  case  relative  to  a  piecewise  linear  classifier  since  class  I 
is  multi- modal  gaussian. 

Figure  5b  shows  the  effect  of  increasing  inter- class  complexity  (as  compared 
to  Figure  5a,   classes  I  and  II)  while  maintaining  intra- class  simplicity.     A 
linear  classifier  cannot  separate  classes  1  and  II.     Note  that  unequal  class 
means  does  not  guarantee  inter- class  simplicity.     Any  instance  for  which 
the  distance  between  means  is  on  the  order  of  the  average  point  spread  about 
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Figure  5b.     Low  Intra-elass  Complexity  with  High 
Inter- class  Complexity 
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Figure  5c.    High  Intra -class  Complexity  with  Low 
Inter-class  Complexity 
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the  mean  for  the  cLasses  involved,  the  linear  classifier's  performance  wilL 
be  poor  (see  Appendix  A. ) 

Figure  5c  shows  the  effect  of  increasing  intra- class  complexity  while  main- 
taining inter- class  simplicity.     The  distribution  of  each  of  the  classes  I    and 
II  in  Figure  5c  does  not  conform  to  a  unimodal  gaussian  density.     However, 
the  classes  are  well  separated  and  one  can  use  a  linear  classifier  in  spite  of 
the  gaussian  assumption  failing.     (Note  that  the  resulting  classifier  is  not 
optimum  for  the  distribution  shown,  but  may  achieve  a  Low  enough  error  rate 
nonetheless. ) 

Finally,  Figure  5d  illustrates  a  case  of  high  overall  complexity,  both  inter- 
and  intra- class,  relative  to  the  gaussian  assumption.     Relaxing  the  unimodal 
assumption  to  a  multimodal  assumption  might  allow  a  piecewise  linear 
classifier  to  be  designed  for  the  example  data,  but  the  choice  of  sub-classes 
is  not  clear.     One  could  separate  classes  I    and  II  of  Figure  5c  into  subclasses 
by  trial  and  error,  but  this  is  obviously  stretching  the  validity  of  the  gaussian 
assumptions.     A  case  such  as  Figure  5c  generally  requires  a  more  powerful 
approach  to  classification,  beyond  the  scope  of  this  handbook,  or  a  new  choice 
of  features  if  one  insists  upon  linear  or  piecewise  linear  classifiers. 

Let  us  return  to  Figure  5a,   classes  I  and  II.     For  this  case,  using  the  unimodal 
assumption,  the  overall  complexity  is  high.     Classes  I  and  II  have  nearly  equal 
means,   and  class  I  does  not  conform  to  a  distribution  resulting  from  a  uni- 
modal gaussian  density.     The  proximity  of  means  for  classes  I  and  II  relative 
to  the  average  spread  about  the  mean  implies  high  inter- class  complexity. 
Thus,  the  actual  intra- class  complexity  of  I  shows  up  as  inter-class  complexity 
unless  it  is  recognized  that  I  is  multimodal.     Under  the  multimodal  assumption, 
the  complexity  of  the  problem  is  low.     This  illustrates  the  need  for  checking 
intra- class  as  well  as  inter- class  complexity. 
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Figure  5d.     High  Inter-  and  Intra-cLass  Complexity 
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The  complexity  of  the  sample  data  distributions  In  the  previous  examples 
was  gauged  by  'eyeball'  methods,  using  the  fact  that  for  n=2,   all  of  the  details 
of  the  distribution  can  be  shown  In  a  scatter  plot  (Figures  5a  through  5d). 
Obviously,  the  generation  of  scatter  plots,  while  easy  for  n=l,  and  2,   Is 
difficult  for  n=3  and  impossible  for  n  greater  than  3.     Generally,  one  must 
rely  upon  projections  onto  a  two  or  three  dimensional  subspace  for  cases 
when  the  feature  space  of  a  dimension  greater  than  or  equal  to  3.     Thus, 
methods  other  than  scatter  plotting  must  generally  be  used  to  gauge  com- 
plexity. 

From  the  example  in  Figures  5a  through  5d,  we  can  see  that  one  approach  to 
measuring  complexity  is  to 

1.  Consider  a  specific  form  of  classifier  (a  certain  set  of 
assumptions  concerning  the  distribution) 

2.  Measure  complexity  with  respect  to  that  classifier  (with 
respect  to  those  assumptions). 

More  general  techniques  for  gauging  complexity  independently  of  a  specific 
classifier  have  been  proposed,  but  such  techniques  are  beyond  the  scope  of 
this  handbook  (see  reference  by  Meisel). 

Under  the  approach  to  complexity  described  in  this  handbook,  the  simplest 
distribution  is  the  one  matching  the  conditions  on  class  probability  densities 
imposed  by  the  specified  classifier.    (This  makes  the  classifier  optimal  In 
the  minimum  probability  of  error  sense).    Conversely,  the  most  complex 
distribution  is  one  for  which  the  conditions  do  not  match,  and  the  assumptions 
on  the  distribution  for  the  given  classifier  are  completely  erroneous. 

We  are  specifically  Interested  in  verifying  the  unlmodal  or  multimodal 
assumptions.     Note  that  our  interest  is  not  in  the  strict  verification  of  these 
assumptions,   only  that  the  distributions  have  enough  of  the  properties  of 
gaussian  distributed  data  for  a  linear  or  plecewlse  linear  classifier  to  be  feasible. 
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Since  we  must  work  with  data  for  which  n  is  greater  than  three,   numerical 
measures  of  complexity  must  be  used  to  augment  projection  scatter  plotting. 
Numerical  measures  of  complexity  are  based  on  the  mathematical  form  of 
the  classifier  considered  (see  Appendix  A).     Complexity  is  gauged  by  the 
CTC  program  using  the  following  computations: 

1.  Euclidean  distance  between  class  (and  subclass)  means, 
and  angles  between  class  means  referred  to  the  overall 
mean 

2.  Statistical  scatter  computations;  cover  iance,   correlation 
coefficients,   standard  deviations  for  the  data 

3.  Projections  onto  subspaces 

4.  Property  listing  (a  single-dimension  scatter  plotting 
technique,   quite  powerful  when  used  in  conjunction 
with  computation  3) 

The  computations  are  described  in  detail  in  Appendix  C.     Property  listing 
is  described  in  Chapter  4,  with  the  description  of  '-7'  control  cards.     These 
methods  for  gauging  complexity  are  well  suited  to  verifying  properties  of  the 
data  relative  to  the  gaussian  assumptions,   and  deciding  how  to  assign  sub- 
classes in  the  case  of  multimodal  classes. 

From.  Appendix  B,   the  multimodal  assumptions  result  in  an  extended  problem 

for  which  the  unimodal  assumptions  are  used.     From  Appendix  A,    Equation 

(A-10), 

n 

r.,      =    (E     Am.2   /  ct.2)"1  (20) 

Jk  L=1  i  l 


whore 


Am.     =     m.    .  -  m. 
i  J,i  k,i 


a2    =    (M.  aj;12+MkaM2)/(M.  +  Mk) 
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is  a  measure  of  inter- class  complexity  that  can  be  easily  computed  from  the 
results  of  computations  1  and  2.     Intra- class  shape  complexity  can  be  mea- 
sured by  the  standard  deviations  and  correlation  coefficients  for  the  class, 
while  modality  (another  aspect  of  intra-class  complexity)  can  be  estimated 
by  using  the  property  listing  computation  together  with  the  projection  com- 
putation.    This  is  described  more  completely  in  the  Subsection  3.  3  example. 

Dimensionality  of  the  data,   in  general,   depends  on  the  number  of  samples 
per  class  and  the  number  of  classes  as  well  as  the  number  of  features  used. 
Requirements  on  dimensionality  necessary  to  reliably  gauge  complexity  and 
classify  the  data  can  be  stated  as  inequalities  involving  these  three  quantities. 

In  most  applications,   one  has  a  limited  number  of  datapoints  and,  hence,   is 
required  to  extract  as  much  information  as  possible  from  them,   even  though 
they  may  be  sparse  in  the  decision  space.     If  it  can  be  determined  that  the 
samples  are  clustered  in  small  regions  of  the  decision  space,  or  have  high 
localized  densities  in  the  space,  the  curse  of  dimensionality  can  be  tempered 
by  considering  these  local  regions  in  designing  the  classifier. 

As  a  rule  of  thumb,   in  higher  dimensional  spaces,  the  possibility  for  com- 
plex sample  distributions  increases,   and  algorithms  based  on  a  mental  image 
of  unimodal  (or  simple)  clusters  of  sample  points  should  be  used  with  caution 
or  not  at  all  (this  is  the  reason  for  gauging  complexity). 

A  rough  indicator  of  the  sample  density  in  the  decision  space  is  the  M. /n  ratio, 

where  M.  is  the  number  of  data  points  in  class  C.  (or  subclass  C.^)  and  n  is 
i  ^  L  L 

the  dimension  of  the  space.     An  example  of  blindly  using  a  set  of  samples  with 
a  small  M. /n  ratio  is  given  in  Meisel  where  it  is  shown  experimentally  that 
M./n  should  be  in  the  range  3  to  5  at  least  (the  larger  the  ratio  the  better)  to 
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prevent  an  apparently  significant  classification  of  samples  from  a  single 
class  into  more  than  one  class.     Another  experiment  has  shown  that  for 
fixed  M-  (hence  fixed  M),   as  n  is  increased  the  performance  of  a  pattern 
recognizer  increases  to  a  maximum  number  of  correctly  classified  samples, 
and  then  decreases.     Thus,   n  must  reflect  the  'intrinsic  dimensionality' 
of  the  data  for  the  best  classifier  performance. 

Although  intrinsic  dimensionality  is  difficult  to  determine  (see  Fukanaga, 
Hughes,   etc. ),  a  closely  related  constraint  that  is  easier  to  use  is  the  N/n 
ratio.     (N  is  the  number  of  classes.)    In  general,   one  must  have  n  greater 
than  or  equal  to  N-l  at  the  beginning  stages  of  classifier  design.     If  the 
resulting  n  is  larger  than  the  intrinsic  dimensionality  of  the  classification 
problem,   certain  characteristics  of  the  data  distribution  will  reflect  this 
fact.     However,   if  n  is  too  small,   one  must  make  new  measurements  to  get 
more  features.     In  addition,   n  smaller  than  the  intrinsic  dimensionality  of 
the  problem  is  manifested  by  high  complexity  of  the  sample  distributions. 
The  above  constraint  can  most  easily  be  understood  by  considering  the  ways 
in  which  the  means  of  N  classes  can  be  distributed  in  X„.     The  most  general 
arrangement  of  N  points  requires  a  set  of  vectors  spanning  N-l  space  to 
retain  the  spatial  relations  between  the  points.     For  example,  two  points 
define  a  line  (if  they  are  equal,  the  degenerate  case  of  a  line,  a  point), 
three  points  define  a  plane  (or  in  the  degenerate  case,  a  line  or  a  point), 
and  so  on.     (Note  that,   in  each  of  these  cases,  N-l  dimensions  were 
required  to  describe  the  most  general  arrangement  of  N  points. 


3.3    A  THREE-CLASS  NUMERICAL  EXAMPLE 

The  example  in  this  section  illustrates  a  number  of  different  analytical 
methods  for  solving  classifier  design  problems.     The  methods  are  based 
on  quantities  that  are  calculated  by  the  Cascaded  Threshold  Classifier 
program.     Mathematical  derivations  for  these  quantities  are  given  in 
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Appendices  A,   B  and  C,  and  Chapter  4  discusses  how  to  use  the  program 
to  obtain  them. 

Three  different  ways  to  solve  this  problem  are  discussed. 

•  MuLtiple  linear  discriminant  solution 

•  Piecewise  linear  solution  using  subclasses 

•  A  layered  machine  solution 

In  each  case  the  complexity  and  dimensionality  of  the  data  are  tested  by 
the  methods  discussed  earlier. 

3.3.1    The  Multiple  Linear  Discriminant  Solution 

Table  1  lists  the  data  that  will  be  used  for  this  example,  which  are  then 
plotted  in  Figure  6.     In  using  the  CTC  program,  the  following  computational 
steps  are  normally  performed: 

•  STEP  0  -  Compute  apriori  probabilities  (class  weights) 

•  STEP  1  -  Distance  computations 

•  STEP  2  -  Statistical  scatter  computations 

•  STEP  3  -  Data  listings 

The  gauss ian  assumption  is  tested  by  using  the  results  of  steps  1,   2  and  3 
(see  Appendix  C  for  details)  as  follows  (For  this  example  feature  1  =  x 
and  feature  2  =  y): 
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TABLE  1.     TEST  CASE  1  DATA,  NUMERICAL  (AS 
GIVEN  BEFORE  DESIGN  PROCESS) 


Item  Feature  1  Feature  2  Class 

13  4  1 

2  5  3  1 

3  5  4  1 

4  5  5  1 

5  4  5  1 

6  4  9  1 

7  5  7  2 

8  5  13  1 

9  6  10  2 

10  7  7  1 

11  8  5  1 

12  8  8  2 

13  8  9  2 

14  8  11  2 

15  8  15  3 

16  9  4  1 

17  10  6  1 

18  10  8  2 

19  10  11  2 

20  10  13  3 

21  11  5  3 

22  11  9  2 

23  11  10  2 

24  11  14  3 

25  11  15  3 

26  12  7  2 

27  12  8  1 

28  12  11  2 

29  12  14  3 

30  13  4  3 

31  13  8  2 

32  13  10  2 

33  13  13  3 

34  14  5  3 

35  14  9  2 

36  14  16  3 

37  15  6  3 

38  16  5  3 

39  16  6  3 


Mj  =  12,   M2  =  14,   M3  =  13 
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Figure  6.     Test  Case  1  Data  Scatter  Plot 
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STEP  0.     A  priori  probabilities  (class  weights): 

P(CL)  =  ^  =>  p(Ci,  =  pi  =  l|  =  o.31 
P(C2)  =  P2  =  ||  =  0.  36 
P(C3)  =  P3  =  ||=  0.33 


STEP  1.     Distance  computations 

m-     =    (x,y)    =     (6.417,   6.083) 


m. 


m. 


m 


TOT 


d(m.  ,   m.) 


(10.07,  9.  143) 
(12.62,  10.08) 
(9.795,   8.513) 

4.766;  i  =  1,  j  =  2 
7.374;  i  =  1/  j  =  3 
2.710;  i  =  2,  j  =  3 


6..    = 
l3 


149.4°;  i  =  1,  j  =  2 
173.3°;  i  =  1,  j  =  3 
37.29°;  i  =  2,  j  =  3 


STEP  2.     Statistical  scatter  computations 

A 


V, 


7.076  0.4653 

0.4653  7.243 

6.923  0.3469 

0.3469  1.837 


[ 


V3    =|  5.  314       -6.  124 
6.124       21.46 


P12(l)  =  0.064999 


p12(2)  =  0.09729 
p12(2)  =-0.5736 
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STEP  3.     Property  listing 

-  on  Feature  1  see  Table  2 

-  on  Feature  2  see  Table  3. 

Note  that  the  data  in  Table  1,  have  n  =  2,  n  =  3,  M-  =  12,   M2  -  14,   M3  =  13, 
hence, 

—    =    N-l  (as  integer  values) 
n  & 

l  >       1=6 
n  2 

and  the  dimensionality  requirements  are  satisfied. 

Thus,  the  above  computations  are  based  on  a  statistically  significant  sample, 
and  the  number  of  features  allows  the  most  general  distribution  of  three 
classes  (co-planar).     We  can  conclude  that  a  reliable  decision  rule  can 
possibly  be  developed  using  the  data. 

To  gauge  the  inter- class  complexity,   the  results  of  steps  1  and  2  are  used 
together  with  equation  (20)  to  get 

=  2 

(21) 


rjk = 

0.25;  j  =  1,  k  =  2 

0.14;  j  =  1,   k  =  3 

[   0.88;  j  =  2,   k  =  3 

as  follows: 

•       j  =  1,  k  =  1    -     Amx2    =    (mx   ±  -  m2      )2  =  (6.417  -  10.  07)2  =  13.34 

An^2    =    (mx   2  -  m2   2)2  =  (6.  083  -  9.  143)2  =  9.  36 

~2          M9A         24.i/         2W9«  -  (12-7.076  +  14-6.923) 
or  j      =    (12^   t    +14cj2j1)/26 ^ 

=    6.99 

~2          /i9A         2,./         2W9R       (12-7.243  +  14-1.837) 
CT2       =    (12(T1,2     +  14cT2,l   )/26  =    26 ' 

=    4.33 
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TABLE  2.     TRADEOFF  FOR  FEATURE  NUMBER  1 


'JATE 

610  ID 

TC1AM1 

TRADEOFF  FQR 

FEATURE 

NUMBER 

1 

\JQ 

ID 

TY 

CL 

SCORE 

0   1 

2 

3 

1 

1 

1 

4 

1 

0 

0 

1 

3« 

0000 

1 

2 

6 

6 

4 

6 

0 

0 

1 

4i 

0000 

2 

3 

5 

5 

4 

5 

0 

0 

1 

4« 

0000 

3 

4 

8 

8 

4 

8 

0 

0 

1 

5« 

oooo 

4 

5 

7 

7 

5 

7 

0 

0 

2 

5« 

oooo 

1 

6 

4 

4 

4 

4 

0 

0 

1 

5« 

oooo 

5 

7 

3 

3 

4 

3 

0 

0 

1 

5« 

oooo 

6 

8 

2 

2 

4 

2 

c 

0 

1 

5« 

•oooo 

7 

9 

9 

9 

5 

9 

0 

0 

2 

6« 

•oooo 

2 

10 

10 

10 

4 

10 

0 

0 

1 

7* 

•  oooo 

8 

11 

15 

15 

7 

15 

0 

0 

3 

8< 

»oooo 

1 

12 

14 

14 

5 

14 

0 

0 

2 

8« 

•  oooo 

3 

13 

13 

13 

5 

13 

0 

0 

2 

8< 

•  oooo 

4 

14 

12 

12 

5 

12 

c 

0 

2 

8« 

•oooo 

5 

15 

11 

11 

4 

11 

0 

0 

1 

8< 

•  oooo 

9 

16 

16 

16 

4 

16 

0 

0 

1 

9< 

•  oooo 

10 

17 

20 

20 

7 

20 

0 

0 

3 

10 « 

•  oooo 

2 

18 

19 

19 

5 

19 

0 

0 

2 

10' 

•  oooo 

6 

19 

18 

18 

5 

18 

0 

0 

2 

10« 

•oooo 

7 

20 

17 

17 

4 

17 

0 

0 

1 

10' 

•  oooo 

11 

21 

25 

25 

7 

25 

0 

0 

3 

11' 

•  oooo 

3 

22 

24 

24 

7 

24 

0 

0 

3 

11' 

•  oooo 

4 

?3 

23 

23 

5 

23 

0 

0 

2 

11 

•  oooo 

8 

24 

22 

22 

5 

22 

0 

0 

2 

11 

•  oooo 

9 

25 

21 

21 

6 

21 

0 

0 

3 

11' 

•  oooo 

5 

26 

29 

29 

7 

29 

0 

0 

3 

12 

•  oooo 

6 

27 

28 

28 

5 

28 

0 

0 

2 

12 

•  oooo 

10 

28 

27 

27 

4 

27 

0 

0 

1 

12 

•  oooo 

12 

29 

26 

26 

5 

26 

0 

0 

2 

12< 

•  oooo 

11 

30 

33 

33 

7 

33 

0 

0 

3 

13 

•  oooo 

7 

31 

32 

32 

5 

32 

c 

0 

2 

13 

•  oooo 

12 

32 

31 

31 

5 

31 

0 

0 

2 

13 

•  oooo 

13 

33 

30 

30 

6 

30 

0 

0 

3 

13 

•  oooo 

8 

34 

36 

36 

7 

36 

0 

0 

3 

14 

•  oooo 

9 

35 

35 

35 

5 

35 

c 

0 

2 

14 

•  oooo 

14 

36 

34 

34 

6 

34 

0 

0 

3 

14 

•  oooo 

1? 

37 

37 

37 

6 

37 

0 

0 

3 

15 

•  oooo 

ll 

38 

39 

39 

6 

39 

0 

c 

3 

16 

•  oooo 

l\ 

39 

38 

38 

6 

38 

0 

0 

3 

16 

•  oooo 

13 
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TABLE  3.     TRADEOFF  FOR  FEATURE  NUMBER  2 


DATE 

610  ID 

TClA^i 

TRADEOFF  F8R 

TFATURE 

U\jV 

BE« 

? 

N8 

ID 

TY 

CL 

SC8RE 

D   1 

2 

3 

1 

2 

2 

'4 

2 

o 

c 

1 

3. 

oooo 

1 

2 

30 

30 

6 

30 

0 

0 

3 

4. 

0000 

1 

3 

16 

16 

4 

16 

0 

0 

1 

4  < 

oooo 

2 

1 

4 

3 

3 

4 

3 

0 

0 

1 

4. 

oooo 

3 

5 

1 

1 

4 

1 

c 

p 

1 

4  . 

oooo 

4 

6 

38 

38 

6 

38 

c 

3 

5« 

oooo 

2 

7 

34 

34 

6 

34 

p, 

Q 

3 

5. 

oooo 

3 

8 

21 

21 

6 

21 

0 

0 

3 

5. 

oooo 

4 

9 

11 

11 

4 

11 

n 

0 

1 

5< 

oooo 

5 

10 

5 

5 

4 

5 

C 

0 

1 

5« 

oooo 

6 

11 

4 

4 

4 

4 

0 

0 

1 

5« 

oooo 

7 

12 

39 

39 

6 

39 

p 

p 

3 

6« 

oooo 

5 

13 

37 

37 

6 

37 

c 

3 

6« 

•  oooo 

6 

1* 

17 

17 

4 

17 

v.,. 

Q 

1 

6< 

oooo 

8 

15 

26 

26 

5 

26 

c 

0 

2 

7- 

ocoo 

1 

16 

10 

10 

4 

10 

o 

0 

1 

7< 

•  oooo 

3 

17 

7 

7 

5 

7 

0 

0 

2 

7« 

•  oooo 

2 

18 

31 

31 

5 

31 

0 

0 

2 

?< 

•  oooo 

3 

19 

27 

27 

4 

27 

n 

V 

o 

1 

8< 

•  oooo 

10 

1 

20 

18 

18 

5 

18 

0 

0 

2 

8  < 

•  oooo 

4 

21 

12 

12 

5 

12 

0 

0 

2 

8< 

•  oooo 

5 

22 

35 

35 

5 

35 

0 

0 

2 

9< 

•oooo 

6 

23 

22 

22 

5 

22 

0 

0 

2 

9. 

•  oooo 

7 

24 

13 

13 

5 

13 

0 

0 

2 

9 

•  oooo 

8 

25 

6 

6 

4 

6 

0 

0 

1 

q. 

•  oooo 

11 

26 

32 

32 

5 

32 

0 

0 

2 

10' 

•  oooo 

9 

27 

23 

23 

5 

23 

0 

0 

2 

10 

•  oooo 

1.0 

28 

9 

9 

5 

9 

0 

0 

2 

10 

•  oooo 

11 

29 

28 

28 

5 

28 

0 

0 

2 

11 

'0000 

12 

30 

19 

19 

5 

19 

0 

0 

2 

11 

•  oooo 

13 

31 

14 

14 

5 

14 

c 

c 

2 

11 

•  oooo 

14 

32 

33 

33 

7 

33 

c 

0 

3 

13 

'OOOO 

7 

33 

20 

20 

7 

20 

0 

0 

3 

13 

•  oooo 

8 

34 

8 

8 

4 

8 

c 

0 

1 

13 

•  oooo 

12 

35 

29 

29 

7 

29 

0 

0 

3 

14 

•  oooo 

9 

36 

24 

24 

7 

24 

0 

0 

3 

1  4 

•  oooo 

10 

37 

25 

25 

7 

2b 

0 

0 

3 

15 

•  oooo 

ll 

38 

15 

15 

7 

15 

0 

0 

3 

15 

•oooo 

12 

39 

36 

36 

7 

36 

0 

0 

3 

16 

•  oooo 

13 
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and  |2,       -.  42 

1         lira.  Am,  \ 

r1    9       =     — l       +      ~  =  4'07 

•       j  =  1,  k  =  3  -     Amj2    =    (mx    1  -  m.^   ^2  =  (6.417  -  12.  62)2  =  38.48 

Am22    =    (rr^   2  -  m3   2)  2  =  (6.083  -  10.  08)2  =  16 

~    2    _     .      -         2              A        2W9_  „  (12-7.076  +  13-5.314) 
CT1      "    (12(T1,1     +13a31)/25-     2^- 

=    6.16 

~2    _     .      *         2           ;        2Wot.  ..  (12-7.243  +  13-21.46) 
cr2      -    (12(1!  2     +13a32)/25- ^ 

=  14.64 


and 


-1    =    38,48  +    JL6_.   _    7   34 
rl,3  6.16  14.64        '"3* 

•       j  =  2,     k  =  3       Am-       =    (m2  !  "  m3   j)  =6.5 

Am2       =    (m2  2  -  m3   2)  =  0.88 

ctx2    =    (14ct2  12  +  13a3  12)/27  =  6.  15 

ct22    =    (14a2  2     +  13a3  22)/27  =  n-29 

and 

r2,3         =    1'13, 

From  (21),  we  can  expect  a  larger  error  rate  for  decisions  between  classes 
C2  and  CL,   since  the  inter- class  complexity  for  C2   and  Co  is  much  higher 
(at  least  twice)  than  for  class  pairs  C.  and  C9  and  C,  and  C„,     This  result 
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tallies  with  an  'eyeball'  examination  of  Figure  6  where  one  can  see  that  class 
Co  brackets  class  C0. 

Intra-class  shape  complexity  and  orientation  is  determined  using  the  results 
from  step  2.     The  values  of  the  cross-correlation  coefficients  p10(i)  and  the 

A  A  1Z 

standard  deviations  cr.    1a   9  are  enough  to  determine  a  closed  contour.     For 

1,1  i,  4 

each  class,    i  =1,    2,    3  such  that,    if  the  Unimodal  Gaussian  (UG)  assumption 
holds,  then 


1)  p(X  |C.  )  =  0.  6065 /K  for  each  X  on  the  contour,   K  =  [  (2n)n  det  Vt  ] 


-1/2 


2)  The  contour  encloses,   and  is  centered  upon  m.,   and  is  ellipsoidal 
in  shape. 

3)  Letting  X.  denote  the  set  of  points  interior  to  the  contour  for 
C.,    we  have  PCXeX^Cj)  =  0.  3935.     This  probability  can  be  de- 
termined for  any  n  using  a  transformation  to  spherical  co- 
ordinates and  integration  by  parts. 


Since 


A  A 


1,1 


p12(i)  %  1  CTi,  2 


P12(i)  \  1  ai,  2 


1,2 


=      V; 


there  values  are  readily  available  for  each  Cj.     Properties  1  and  3  ensure 
that  the  shape  of  each  contour  (property  2)  is  similar  to  the  shapes  for  other 
classes. 


.th 


To  determine  the  shape  of  the  i      class  under  the  UG  assumptions,  we  deter- 

A  A  A  A,  A  A  A 

mine  m.  and  the  four  points  (m.    .,   ±  cr.    -,   m.    0),    (m.    -,   m.   9  ±  cr.   0),  as 

1  1,  1  1,  1  1,  £  1,  1  1,  ^  1,  <2 

shown  in  Figure  7a.    These  points  are  on  the  ellipsoidal  contour  with  center 
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m.  and  having  a  major  axis  of  slope  a^U)  through  m..  Figure  7b  shows  the 
contours  for  each  of  C..,  Cp,  and  C~.  (Note  the  similarity  between  contour 
plotting  and  scatter  plotting  of  the  data.  ) 

From  Figure  7b,  we  can  see  that  there  is  extensive  overlap  between  classes 
C~  and  C^,   and  that  C„  is  widely  dispersed  compared  to  C     and  C„,    since 
each  of  the  contours  shown  is  equi-probable  (property  3).     This  large  disper- 
sion is  an  indicator  of  a  multi-modal  class,   but  is  not  conclusive. 

If  we  did  not  check  modality,  the  results  of  computations  1  and  2,   given  by 
equation  (21)  and  Figure  7b  tell  us  that  classes  C„  and  C,,  cannot  be  reliably 
separated  by  a  linear  classifier  on  features    1  and  2  (i.  e.   using  the  UG  as- 
sumptions will  not  lead  to  an  acceptable  classifier).     To  show  this,  we  de- 
sign the  linear  classifier  for  C1 ,   C„,   and  C„  as  follows: 

From  Appendix  A,  equation  (A- 9),  we  have  the  expression  for  the  two-class 
discriminant  function  A  „  (X).  We  use  this  for  each  of  the  class  pairs  C.C„, 
C   Cg,   and  C2C3  to  get  the  decision  rules,    (i,  j)  =  (1,  2),    (1,  3),   and  (2,  3), 

C. 

3 

A..CX)    =    (XT  -  pPm?  -  p*mT)    V7.1     (m.  -  m.)  -  KT(i,j)^   0.        (22) 

i]  i      i  3     3  i]  3  i  L  < 

C. 
l 

Using  equations  (A-7)  and  (A-8),  we  have  the  equivalent  form 

C. 

3 

A..(X)    =    XT  •  W.    .  -  Wn    .    .    *  0  (23) 

13  i,3  0,1,3  < 

C. 

i 


where 


(W,    .    .,   W„    .    .)    =    Vf1  (m.  -  m.) 
l,i,3         2,i,3  i,3        3  i 

Wn    .    .    =    KT(i,i)  +(p3m.  +  p!m.)T  v'1.  (m.  -  m.) 
0,i,3  L      J  ii33  i,3        3  1 
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(24) 


Y  (FEATURE  2) 


7a 


,2 


'*i,l 


SLOPE     P12(i) 


>  X  (FEATURE  1) 


U 


FEATURE  2 


20- 


P12(l)  =  .065a!   x=  2.66  ax  2=  2.69 


10 


P12(2)=  .097CT2   x=  2.63  CT2  2=  1.36 


o      (3)=  -  573°"       =  2.31  o        =4.63 
13  3,1  3,2 


0  ' r 


— I 1 r 

10 


-. 1 ►FEATURE    1 


20 


7  b 


Figure  7,     Contour  Approximation  to  Distribution  Shape 
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and 


P^ 


M.                       P(C.) 
3    =   1 =    L_ 


1         M.  +  M.  P(C.)  +  P(C.) 

i  3  13 


i 


P 


M.  P(C.) 

3  =  3 


J         M.  +  M.  P(C.)  +  P(C.) 

13  13 

The  CTC  program  determines  the  decision  surface  using  the  form  (j>i)  (the 
reason  for  choosing  equation  (25)  is  explained  in  Chapter  2,    and  in 
Appendix  A# 


T"  1  "  1/*T,A  —  1 


A         .«  A  A 


A..       (X)    =    [X      -  (p.m.  +  p.m.p]  V..    (m.  -  m.)  (j  -  i)  p.p. 
13  3     3         1     1  13         3  1  13 


3 

J 


+    ip?  +3  p.  <    const  (i,  3) 

C. 

1 

where  const(i,  3)  is  determined  so  as  to  minimize  the  error  rate  on  the  samples, 

by  using  a  property  listing  of  the  classifier  output  (score)  determined  by  com- 

ACTC 
puting  A  ..       (X),  as  given  on  the  left  side  of  the  inequality  (25).     This  can  be 

J 

seen  equivalent  to  equation  22  by  defining 

5".  i 
-KT(i,j)    =     1Pi  +  3P3,  .  const  (i,  3)  (26) 

(3  -i)  p3.pi      <j-i)pipj 


and  taking 

A..(X)    =    A^.TC(X)  /  [j-ilp^.p.1. 

CTC 

The  resulting  coefficients  W,     .    .  ,   k  =  0,    1,   2,   the  (i,  3)  pairs  as  before,   are 

computed  by  the  CTC  program  as  in  Table  4,   and  are 
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(i,  3) 

-w^c 

0,1,3 

1,   1,3 

w?TC 

2,1,3 

1,2 

0.3648 

0.06199 

0.0846 

1,  3 

-0. 3233 

0. 1810 

0.07582 

2,3 

1.  076 

0.09239 

0. 03776 

where,   using  (25) 


ACTC(X) 
13 


3 

=  x  •  (w^TC.,  w^TC  )  -  w^TC    J  0 

1,1,]'       2,i,  3  0,1,3     < 

C. 

1 


(27) 


with 


wc.TC    =   (WC 


W 


CTC  ,T 


.-1 


J  J 


-L.^.)i     =     v.    .    (m.  -  m.)  (3  -  i)  pJ.p. 
13  l,i,3         2,1,3'  *>3        3  l  1  ^ 


(28) 


and 


W 


CTC 
0,1,  j 


w 


CTC 
0,  i,  3" 


CTC 


]*  1  *> 

const  (i,   i)  +  [(p.m.  +  p.m.)  •   W. 

J  ii33  M 


3     .    1 
1P-3P3] 


The  values  for  const(l,    2),   const(l,    3),   and  const(2,    3)  are  determined  from 

the  property  listings  given  by  Tables  5  through  7).     The  'SCORE'  column  gives 

the  value,   for  each  sample  point  X  ,   r  =  1,    •  •  • ,    39,    (see  equation  (2  8)  for 
CTC  r 

w;r  Ly. ) 

0,i,3 
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TABLE  4.     PAIRWISE  CLASSIFIER  COEFFICIENTS 


InVEwSE 

<1    ■    1 

r<2    ■    1 

L;ET    «    58*555530294 

1         2       »3648  •6199E-01        •846oE"Ol 

INVERSE 
<1    «    1 
*2    ■    1 
DET    «    28?«S3l?9636> 

1         3    -t3233  •181C  .7582E-01 


INVEKSE 

Kl     m      1 

<2    ■    1 

UET    *    84.5588579*? 

2         3      1»C76  »9239E-C1       -3776E-Q1 
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TABLE  5.     TRADEOFF  FOR  PAIR  1,   2 


L-'ATE   615  ID  TCI' 
TRADE9FF  F9R 
pAIR     1   2 


■  TT 


L9EFF 


* 

36483 

•06198 

•08459 

NP 

ID 

TY 

CL 

1 

1 

1 

c 

0 

0 

1 

2 

2 

2 

£ 

0 

0 

1 

3 

3 

3 

0 

0 

1 

k 

5 

5 

■j 

0 

0 

i 

5 

4 

4 

j 

0 

r» 

1 

6 

16 

16 

j 

0 

c 

1 

7 

7 

7 

? 

0 

0 

2 

8 

11 

1  1 

0 

'J 

^« 

1 

9 

6 

6 

o 

1 

10 

10 

10 

u 

0 

/-> 

1 

11 

21 

?1 

3 

o 

0 

n 

3 

12 

17 

17 

1 

;"; 

Q 

C 

1 

13 

30 

30 

3 

0 

r 

0 

3 

1* 

12 

12 

? 

c 

r\ 

0 

p 

1-5 

9 

9 

2 

0 

c 

c 

? 

16 

13 

13 

2 

f 

Pi 

2 

17 

34 

^ 

3 

' 

n 

Q 

3 

18 

1  8 

18 

2 

c 

r\ 

0 

? 

19 

26 

~6 

2 

.J 

c 

0 

T 

20 

8 

8 

1 

c 

c 

n 

1 

21 

38 

38 

3 

£ 

0 

-l 

3 

22 

27 

?7 

1 

c 

r 

Q 

1 

23 

1* 

1* 

? 

n 

p 

p 

24 

37 

^7 

3 

r 

o 

C 

3 

25 

22 

22 

p 

r 

r 

0 

c 

26 

31 

31 

2 

2 

n 

r 

?7 

39 

39 

3 

Q 

Q 

r* 

3 

28 

23 

?3 

? 

0 

5 

? 

29 

19 

19 

? 

f, 

r> 

- 

2 

30 

35 

35 

2 

vj 

r 

0 

c 

31 

32 

32 

? 

J 

^' 

0 

2 

32 

28 

'8 

p 

vj 

c 

c 

? 

33 

20 

2  0 

4 

C 

r\ 

3 

3 

3* 

15 

15 

4 

0 

7) 

*> 

3 

35 

24 

?4 

4 

r 

r 

3 

36 

33 

33 

4 

o 

Q 

c 

3 

37 

29 

?9 

4 

/-; 

r, 

J 

3 

33 

25 

25 

4 

G 

C 

0 

3 

39 

36 

36 

4 

2 

r 

c 

3 

3  errors  minimum 
const  (1,  2)  = 

1.4922  +     (1-5374 
2 
=     1.5148 


1.4922) 
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TABLE  6.     TRADEOFF  FOR  PAIR  1,   3 


-ATE       615     ID    TCI' 
"TRADfc^FT    F3R 

Pair  i      3 


•TT 


.BEF> 


•  • 

32328 

•1? 

098 

•  C7 

SI© 

ID 

TY 

1 

1 

1 

"u 

r> 

2 

5 

5 

r. 

L; 

3 

2 

2 

V 

r 

4 

3 

3 

£ 

0 

5 

4 

4 

2 

V 

6 

6 

6 

o 

ij 

7 

7 

7 

? 

Z 

C 

8 

10 

1  0 

0 

r; 

9 

11 

11 

r, 

^ 

10 

9 

9 

2 

n 

11 

8 

3 

u' 

o 
o 

12 

16 

16 

Q 

Q 

13 

12 

12 

2 

c 

c 

1* 

13 

13 

2 

0 

c 

15 

17 

17 

1 

0 

c 

16 

1^ 

14 

o 

0 

o 

17 

21 

21 

3 

U 

c 

18 

18 

1  8 

2 

G 

c 

19 

15 

15 

4 

c 

o 

20 

19 

19 

2 

c 

0 

21 

30 

30 

3 

c 

c 

22 

22 

22 

2 

G 

c 

23 

26 

?6 

? 

<j 

0 

24 

23 

?3 

2 

0 

o 

25 

27 

27 

1 

u 

c 

26 

20 

20 

4 

p 

G 

27 

34 

34 

3 

0 

0 

28 

31 

31 

2 

0 

p 

29 

28 

28 

2 

g 

c 

30 

24 

24 

4 

u 

n 

31 

32 

32 

? 

u 

0 

32 

25 

25 

4 

0 

0 

33 

37 

37 

3 

G 

c 

34 

35 

35 

2 

w 

0 

35 

29 

29 

4 

0 

0 

36 

38 

38 

3 

J 

0 

37 

33 

33 

4 

0 

fl 

38 

39 

39 

3 

v> 

c 

39 

36 

36 

4 

J 

n 

1 


SC3<?F 

>5?29 

•  7797 

-8o91 

•  «R49 

•  9^,07 

1 

0*30 

1 

■1123 

1 

>4743 

1 

.5  36 

1 

•5-07 

3-1 

1 

■  5^72 

.6-«8 

1 

•7311 

2  X 

.3-*9 

i  <X 

.9U14) 

>9C85 

2  d 

-r^f>5) 

1      2 

•093^ 

o ? 

>261* 

? 

3??5 

? 

3327 

p 

.3498 

p 

.379? 

? 

4-56  ( 

? 

455C 

? 

4721 

p 

-52°5 

j" 

-6359 

P 

•  6ffP4 

P 

>7?«9 

P 

7'76 

?< 

S  4  7 

? 

8463 

2< 

8^27 

? . 

9"  99 

? 

9514 

3 

01 50 

T. 

Cp7? 

3. 

4p35 

@ 


s 
3 

i: 


n 
l? 

13 


14 


7 

8 

9 
JO 
ll 

12 

,  3 


1  error  minimum 

const  (1,  3)  - 

1  94M   +    (2.0465-  1.9414) 


=  1.9940 
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TABLE       7.     TRADEOFF  FOR  PAIR  2,   3 


•>AT£ 

615  ID 

TCI  - 

-TT 

T^ADt 

HFT  PPR 

PAIR 

?   3 

L8FFF 

1" 

07578 

•  092^ 

•03775 

SI  8 

ID 

TY 

cu 

sc'iRF 

1 

? 

3 

1 

1 

1 

c 

r, 

r- 

l  • 

5  .39 

1 

2 

5 

5 

0 

0 

l  • 

6PM 

2 

3 

2 

2 

'] 

c 

t 

l« 

6=  -.9 

3 

4 

3 

3 

0 

rj 

r 

1  • 

6  =  "7 

4 

c 

4 

it 

c 

- 

r 

l  < 

7p64 

5 

fc 

6 

6 

'/• 

; 

0 

i  < 

7851 

6 

7 

7 

7 

2 

r* 

0 

l ' 

8M9 

1 

8 

10 

10 

Q 

0 

n 

l  - 

9K«,7 

7 

9 

11 

11 

c 

c 

C 

2. 

0'36 

3 

10 

9 

9 

2 

- 

r 

0 

P  , 

0-76 

p 

11 

8 

a 

2 

G 

n 

P  . 

0?85 

0 

12 

16 

16 

r. 

r 

r> 

2. 

n5«2 

10 

13 

12 

12 

2 

f\ 

0 

0 

p 

2 

1168 

3 

I* 

13 

13 

2 

Q 

p 

Q 

r 

2' 

1546 

4 

15 

17 

1  7 

1 

£ 

Q 

c 

i 

p 

2261 

11 

16 

1* 

1* 

2 

^ 

c 

c- 

2 

p 

23")1 

eS 

9 

17 

21 

21 

3 

J 

C) 

Q 

^ 

? 

2a07 

1 

-  10 

1? 

18 
15 
19 

18 
15 
1  9 

2 

2 

Q 

c 

0 
0 

jj 

2 

3 
2 

2 
P 

P 

3  16 

^ 

g 

19 

>3»11 

2 

10 

20 

41  49 

7 

9 

21 

30 

30 

3 

Q 

0 

r. 

3 

2 

4P77 

3 

10 

2? 

22 
26 
23 
27 

22 
?6 

73 

37 

2 
2 

1 

0 

o 

0 

0 

c 

0 

1 
C. 

r. 

C 

2 

2 
2 

1 

P 
p 

p 
? 

4P1  7 

8 

g 

23 

4486 

9 

8 

P4 

.4695 

1? 

7 

?5 

.48ft* 

12 

26 

20 

20 

1 

0 

0 

3 

? 

■  490* 

4 

8 

27 

3* 

34 

3 

0 

r- 

3 

2 

•  5C79 

5 

9 

28 

31 
28 

31 

-8 

2 
2 

J 

r 
r 

A 

2 

2 

P 
p 

•  5787 

11 

8 

29 

.5996 

12 

7 

30 

2* 

?4 

4 

^ 

0 

0 

3 

p 

•  6po5 

6 

-  8 

31 

32 

25 

32 
?5 

2 
4 

p 

C 

0 

o 

2 
3 

? 

p 

.65*3 

13 

7 

32 

.6^83 

7 

8 

33 

37 

37 

3 

u 

0 

0 

3 

p 

•  69«0 

8 

9 

3* 

35 

3  5 

? 

0 

c 

c 

2 

2 

.7C89 

14 

-  8 

35 

29 

?9 

4 

r 

0 

^ 

2 

•7i29 

q 

36 

38 

P8 

3 

r 

r\ 

0 

3 

2 

.7426 

1  - 

37 

33 

33 

4 

' 

-, 

r, 

3 

? 

.7675 

ll 

38 

39 

39 

3 

J 

0 

7. 

3 

3 

•7PC* 

12 

39 

36 

36 

4 

c 

0 

j 

3 

2 

•  9731 

-3 

7  errors  minimum, 
no  unique  choice  for 
const  (2,  3) 


2.4695  t  2.4904 


2.5996  +  2.6205 


2.6543  +  2.6583 


2.47995 


=  2.61005 


2.6563 
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score  (r)    =    X     •    (W^TC  ,   W?TC  )  -  (prim.  +  p*m.)  -   WCTC 
r  1,1,3'        2,i,  3         VHi     l       K3     y  1,3 

i,  3  ■  3       •    i 

J  ~  ipr.  -  3P     . 

Thus, 

i  =  1,   j=2:    (2.2-  14)    =»  const(l,    2)    =    1.  5148     (3  errors) 

i  =  1,  j=3:    (2.2  -  15)    =»  const(l,    3)    =  1.9940      (1  error) 

i  =  2,   j=3:    (2.2  -   16)    =>  const(2,    3)    =     (2.47995      (7  errors) 

2.  61005       (7  errors) 
2. 6563         (7  errors)  . 

Note  that  ratios  of  the  interclass  complexity  r-,  9  /ris,   etc.    (equation  21)  pro- 
vide a  coarse  estimate  of  ratios  of  the  above  error  rates. 

Further  note  that  our  troublesome  C„  C~  pair  has  no  unique  solution  for  the 
minimum  error  rate  of  7. 

What  is  the  source  of  our  trouble  with  C9  C„?  (It  is  obvious  when  the  data 
are  plotted  as  in  Figure  6,  but  we  are  designing  the  classifier  as  if  such  a 
plot  were  not  available.  ) 

Let  us  summarize  the  results  obtained  so  far: 

i)       r9   „  is  large  (interclass  complexity)  relative  to  other  class 
pairs 

ii)       C~  is  widely  dispersed  throughout  Xf  compared  to  other  classes 
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CTC 
iii)       the  best  linear  discriminant  A  „    o(X)  is  not  unique  and  the 

minimum  error  rate  on  the  samples  is  high,    compared  to 

other  class -pair  decision  rules,   each  of  which  has  a  unique 

low  error  rate. 


Each  of  i,  ii,  and  iii  is  a  characteristic  of  a  problem  for  which  one  of  the 
classes  in  a  'difficult'  class  pair  is  multimodal  with  the  modes  arranged 
so  that  the  difficult  pair  is  not  linearly  separable. 

Note  that  since  the  classes  C.  and  C„  are  well  separated  using  a  linear  de- 
cision rule,    this  shows  that  multimodality  in  itself  is  not  necessarily  a 
problem  (C,    is   bimodal      C.   is  not).     Only  when  the  modes  lie  on  either  side 
of  another  class  do  the  problems  arise  in  using  the  UG  assumptions  to  de- 
sign a  classifier. 

To  check  modality  for  this  three-class  problem,    since  i,    ii,   and  iii  indicate 
the  possible  presence  of  a  multimodal  class  with  the  modes  arranged  in  X^ 
so  as  to  'bracket'  another  class,   we  use  the  property  listings  of  Table  2  and 
3.     Table  2  does  not  indicate  multimodality  for  any  of  the  classes  (projection 
onto  Feature  1).     Table  3  tells  the  story:,  note  the  two  clusters  of  sample 
points  for  class  C„.     This  property  listing  on  Feature  2,    together  with  re- 
sults i,    ii,   and  iii,    provides  compelling  evidence  that  C„  is  multimodal  in 
such  a  way  that  the  UG  assumptions  cannot  be  used  to  design  a  reliable 
linear  classifier. 


3.  3.  2    Piecewise  Linear  Solution  Using  Subclasses 

We  will  next  extend  the  multimodal  gauss ian  (MG)  problem  to  a  four-class 
UG  problem.     From  the  results  of  the  preceding  section,   we  know  that  C~  is 
bimodal,   with  the  sample  points  arranged  in  two  modes  as  (from  Table  3): 
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Mode  1:    {X   :    r  =  30,   38,   34,    21,   39,   37}  (type  6) 

Mode  2:    [X  :    r  =  33,   20,    29,    24,    25,    15,   36}         (type  7). 

If  the  property  listings  on  each  feature  are  not  sufficient  to  group  data  points 
into  separate  modes  as  done  above,   other  projections  must  be  used  for 
property  listing.     Some  useful  projections  are  described  in  Appendix  C  for 
such  cases.     Using  these  data  types,   the  extended  four  class  problem  is 
attacked  using  the  type  to  class  conversion. 


Type 

Class 

4 

1 

5 

2 

6 

3 

7 

4 

As  before,    the  computations  required  for  complexity  analysis  and  classifier 
design  give  the  following  results: 

Step  0.      A  priori  probabilities  (class  weights);  M  =  39 


i 

M. 
l 

M. 
P<Ci>  =  M 

1 

12 

0.31 

2 

14 

0.36 

3 

6 

0. 1538 

4 

7 

0. 1795 
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Step  1.      Distance  computations 


m. 


m, 


m. 


m. 


(6.417,  6.083) 

(10.  07,  9.  143) 

(14.  17,  5.  167) 

(11. 29,  14.  29) 


d(m  ,  m.) 
L,       y 


e. 


L3 


1  4. 766 

i  =  l, 

3=2 

= 

j  7.  804 

i=l, 

3  =  3 

J  9.  539 

i=l, 

3=4 

\  5.  708 

i=2, 

3=3 

5.  284 

i=2, 

3=4 

9.  563 

i=3, 

3=4 

149. 

4°   , 

i= 

=  1, 

3  =  2 

106. 

8°   , 

i: 

=  1, 

3  =  3 

140. 

2°   , 

i= 

=  1, 

3=4 

103. 

7°   , 

i= 

-2, 

3  =  3 

9. 

219°, 

i- 

--2, 

3=4 

113. 

0°   , 

i- 

:3, 

3=4 

Step  2.      Statistical  scatter  computation 


V, 


V, 


V, 


7. 

076 

0. 

4653 

0. 

4653 

7. 

243 

6. 

923 

0. 

3469 

0. 

3469 

1. 

837 

3. 

139 

0. 

6389 

0. 

6389 

0. 

4722 

p12(l) 


P12(2) 


=  0. 06499 


0. 09729 


p12(3)  =  0.  5248 
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V, 


3.347     0.2041 
0.2041    1.061 


P12(4)    =    0.  1 


083 


Step  3.      Property  listing  -  on  Feature  1  in  Table  8 

-  on  Feature  2  in  Table  9. 

Since  we  have  extended  the  original  three -class  problem,   dimensionality 
must  be  checked  again: 


n    =  2,     N  =  4,     M.  >  6 

'  '         i 


hence 


M 


i>    3,        N-l  £    n    , 


n 


Mi  N  N         1 

and  the  —  constraint  is  barely  satisfied,   while  the  —  constraint    —  ^  — 7 
n  j  >  n  n      1    1_ 

N 
is  not  satisfied. 


We  will  continue  with  the  solution  in  spite  of  this,   because  dimensionality 
constraints  were  satisfied  for  the  original  three-class  problem.     Since  the 
statistical  representativeness  of  the  extended  problem  is  not  clear,    the 
classifier  will  have  to  be  designed  by  making  use  of  high  sample  density 
regions  in  feature  space  when  ambiguous  cases  arise  [i.  e.  ,   multiple  minima 
when  choosing  const(i,  j)]. 
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TABLE  8.     TRADEOFF  FOR  FEATURE  NUMBER  1 


UATE 

610  ID 

TC13 

Ml 

TRADEOFF  F9R 

FEATURE 

NUMRE': 

1 

N8 

ID 

TY 

ci 

SCORE 

0   1 

2 

3 

4 

1 

1 

1 

4 

1 

0 

o 

3« 

oooo 

1 

2 

6 

6 

4 

6 

0 

0 

4« 

oooo 

2 

3 

5 

5 

4 

5 

0 

0 

4« 

oooo 

3 

4 

8 

8 

4 

8 

c 

0 

5« 

oooo 

4 

5 

7 

7 

5 

7 

0 

0 

2 

5. 

•  oooo 

1 

6 

4 

4 

4 

4 

0 

*s 

5. 

oooo 

5 

7 

3 

3 

4 

3 

0 

0 

5. 

•  oooo 

6 

8 

2 

2 

4 

2 

0 

0 

5< 

•  oooo 

7 

9 

9 

9 

5 

9 

■J 

r 

2 

6« 

•  oooo 

2 

10 

10 

10 

4 

1C 

0 

0 

1 

7« 

•  oooo 

8 

11 

15 

15 

7 

15 

0 

0 

<♦ 

8. 

•  oooo 

1 

12 

14 

14 

5 

14 

0 

2 

8< 

•  oooo 

3 

13 

13 

13 

5 

13 

0 

0 

2 

8« 

•  oooo 

4 

1* 

12 

12 

5 

12 

r\ 

0 

2 

fl  , 

•  oooo 

5 

15 

11 

11 

4 

11 

r. 

c 

1 

8« 

•  oooo 

9 

16 

16 

16 

4 

16 

0 

r. 

1 

9< 

•  oooo 

10 

17 

20 

20 

7 

20 

0 

4 

10' 

•  oooo 

? 

18 

19 

19 

5 

15 

0 

0 

2 

10 

•oooo 

6 

19 

18 

18 

5 

1-8 

0 

0 

2 

10" 

•  oooo 

7 

20 

17 

17 

4 

17 

0 

0 

1 

10 

•  oooo 

11 

21 

25 

25 

7 

25 

0 

0 

4 

11 

•  oooo 

3 

22 

24 

24 

7 

24 

0 

0 

4 

11 

•  oooo 

4 

23 

23 

?3 

5 

23 

0 

0 

2 

11 

•  oooo 

8 

24 

22 

22 

5 

22 

0 

0 

2 

11 

•  oooo 

9 

25 

21 

?1 

6 

21 

0 

v.- 

3 

11- 

•  oooo 

1 

26 

29 

29 

7 

29 

0 

0 

4 

lS 

•  oooo 

5 

27 

28 

28 

5 

28 

0 

0 

2 

12< 

•  oooo 

10 

28 

27 

27 

4 

27 

0 

I. 

1 

12« 

•  oooo 

12 

29 

26 

26 

5 

26 

0 

0 

2 

12« 

•  oooo 

11 

30 

33 

33 

7 

33 

0 

0 

4 

13 

•  oooo 

6 

31 

32 

32 

5 

32 

0 

0 

2 

13. 

•  oooo 

12 

32 

31 

31 

5 

31 

0 

c 

2 

13.0000 

13 

33 

30 

30 

6 

30 

0 

0 

3 

13.0000 

2 

34 

36 

36 

7 

36 

0 

0 

4 

14.0000 

7 

35 

35 

35 

5 

35 

0 

2 

14.Q000 

14 

36 

34 

34 

6 

34 

0 

0 

3 

14.Q000 

3 

37 

37 

37 

6 

37 

0 

0 

3 

15.0000 

4 

38 

39 

39 

6 

39 

0 

0 

3 

16.0000 

5 

39 

38 

38 

6 

3b 

0 

3 

16 

•  oooo 

6 
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TABLE  9.     TRADEOFF  FOR  FEATURE  NUMBER  2 


-ATE 

610  ID 

TC13 

*1 

TRADE9FF  F*R 

FT.  ATUPE 

NUW. 

<ER 

2 

N8 

ID 

TY 

ci 

1 

2 

2 

4 

2 

0 

0 

1 

2 

30 

30 

6 

3g 

0 

0 

3 

3 

16 

16 

4 

16 

o 

0 

1 

4 

3 

3 

4 

3 

0 

0 

1 

5 

1 

1 

4 

1 

c 

0 

1 

6 

38 

38 

6 

38 

0 

0 

3 

7 

34 

34 

6 

34 

c 

0 

3 

8 

21 

21 

6 

21 

G 

r 

3 

9 

11 

11 

4 

11 

C 

0 

1 

10 

5 

5 

4 

5 

0 

1 

11 

4 

4 

4 

4 

0 

0 

1 

12 

39 

39 

6 

39 

0 

r, 

3 

13 

37 

37 

6 

37 

u 

n 

3 

14 

17 

17 

4 

17 

0 

1 

15 

26 

26 

5 

26 

w 

0 

2 

16 

10 

10 

4 

10 

f"N 

0 

1 

17 

7 

7 

5 

7 

0 

0 

2 

18 

31 

31 

5 

31 

o 

0 

2 

19 

27 

?7 

4 

27 

o 

0 

1 

20 

18 

1  3 

5 

1  3 

r> 

0 

2 

21 

12 

12 

5 

12 

r 

0 

2 

2? 

35 

35 

5 

3  b 

0 

2 

23 

22 

?? 

5 

?? 

0 

2 

24 

13 

13 

5 

13 

i"\ 

o 

25 

6 

6 

4 

6 

0 

o 

1 

26 

32 

32 

5 

32 

0 

3 

27 

23 

23 

5 

23 

0 

Q 

2 

28 

9 

9 

5 

9 

0 

0 

P 

29 

28 

28 

5 

28 

r. 

0 

2 

30 

19 

19 

5 

19 

ij 

o 

2 

31 

14 

14 

5 

14 

pi 

0 

2 

32 

33 

33 

7 

33 

C 

0 

4 

33 

20 

20 

7 

20 

0 

4 

34 

8 

8 

4 

8 

0 

0 

1 

35 

29 

29 

7 

29 

0 

0 

4 

36 

24 

24 

7 

24 

0 

0 

4 

37 

25 

25 

7 

25 

0 

0 

4 

38 

15 

15 

7 

15 

0 

r, 

4 

39 

36 

36 

7 

36 

0 

0 

4 

schrf 


3 
4 
4 
4 
4 
5 
5 
5 

f— 

f, 

6 
6 

7 
7 
7 
8 

8 
8 

R 

9 
9 

Q 

9 
10 
10 
10 

11 
11 

11 

13 
13 
13 
14 
14 
15 
15 
16 


00 
00 
00 
00 
00 
00 
00 
00 
00 
CO 
00 
00 
00 
00 
00 
00 
00 
CO 

r>  ->. 

00 
00 

00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
CO 
00 
00 
00 


00 
00 
00 
00 
00 
00 
00 
00 
CO 
00 
CO 
00 
00 
00 
00 
00 
00 
CO 
00 
CO 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 
00 


8 

9 

10 


H 


2 
3 

4 
5 

A 

7 

5 

9 

lo 

11 

12 
13 
14 


12 


1 

? 

3 
4 
5 
6 

7 
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The  inter-class  complexity  measure  is 


jk 


f  0.  25       : 

3  =  1, 

k=2 

0.  09 

3  =  1, 

k=3 

0.  06       , 

-        3  =  1, 

k=4 

0.  07 

-        3  =  2, 

k=3 

0.  06 

-         3=2, 

k=4 

0.03 

-         3  =  3, 

k=4 

(29) 


where,   from  Equation  (20), 


(J  : 


r    kA2   ^  ^  A  2 

P3  V  +    P^gk,i 

IcT — 3 

P3+Pk 


2  2 

M.  a    -  +  M.   a,    ■ 
3    3, 1  k    k,  i 

M.  +  M. 
3  k 


(i,j) 

a      2 
Am 

A       2 

Am2 

-  2 
CT1 

^  2 
a2 

-1 
r. . 

(1,2) 

13.  34 

9.  36 

6.99 

4.  33 

4,07 

(1,3) 

60.  11 

0.  84 

5.  76 

4.99 

10.  60 

(1,4) 

23.75 

67.  35 

5.  70 

4.  97 

17.72 

(2,3) 

16.  81 

15.  81 

5.  79 

1.43 

13.96 

(2,4) 

1.49 

26.49 

5.73 

1.  53 

17.  57 

(3,4) 

8.  29 

83.  23 

2.99 

0.79 

30.  61 

Intra-class  shape  complexity  is  plotted  in  Figure  3  using 


i 

CTil 

ai2 

P12(i) 

1 

2.  66 

2.69 

0.  065 

2 

2.63 

1.36 

0.  097 

3 

1.  77 

0.  69 

0.  525 

4 

1.83 

1.03 

0.  108 

and  the  points  m.  from  computation  1. 
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Figure  8.     Intra- class  Shape  Complexity  Plot 
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Finally,   no  class  shows  multimodality  on  the  property  listings  on  Feature  1 
and  2  in  Tables  8  and  9. 

From  the  foregoing  results  it  can  be  seen  that  the  four-class  problem  fits  the 
UG  assumptions  quite  well,   hence  the  original  three-class  problem  is  a  three- 
class  MG  problem  with  a  piecewise-linear  discriminant  classifier  solution. 
From  Appendix  B,   we  know  that  the  linear  classifier  solution  to  the  four- 
class  UG  problem  gives  the  piecewise-linear  solution  to  the  three-class  MG 
problem.     The  CTC  program  solves  the  four-class  problem,   using  linear 
discriminants,   as  follows:    (see  program  output  in  Table  10). 


(i,j) 

~  CTC 

WlCTC 

l!J 

W?TC 
2i3 

1,2 

0.  3648 

0. 06199 

0.  08460 

1,3 

0.  311 

0. 1779 

-0.  04246 

1,4 

-0.  845 

0. 1070 

0.  2275 

2,3 

2.964 

0.  04507 

-0.  1475 

2,4 

-0. 6936 

-0. 00396 

0.  3057 

3,4 

2.774 

-0. 01938 

0. 1001 

and  from  Tables  11  through  16, 


(i,j) 

const(i,  j) 

# 

errors 

1,2 

1.  51 

3 

1,3 

2.  144 

2 

1,4 

2.92 

0 

2,3 

2.  60 

0 

2,4 

3.  02 

0 

3,4 

3.45 

0 
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TABLE  10.     PAIRWSE  CLASSIFIER  COEFFICIENTS 


1*0*2  9.219  113*0 

^ETH*D      1 

INVEKSE 

<1    ■    1 

<2    ■    1 

DET    ■    58.555530294 

1         2       *3648  t6l99E-rl       .846qE-01 

INVERSE 
<1    ■    1 
<2    ■    1 

DET    >    97*744513062 

1         3       -3110  »1779  -.4P46E-01 

INVERSE 
<1    ■    1 
<2    ■    1 
'JET    »    137*98279634 

1  4    -.g^Ki!-,  *1070  *2?75 
INVERSE 

<1    •    1 
<2    «    1 

DET  ■  35.2890000^6 

2  3      2«96<*  *45.;;7E-cl    -*1475 

INVERSE 
<1    ■    1 

<2    ■    1 

DET    -    4?. 3280^2367 

2  4    -#6936  *3960E-C2       »3o57 

INVERSE 

<1    -    1 

<2    «    1 

DET    -    76*t500227722 

3  4      2.774  -.1938E-:;!       •  1001 


'0000 
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TABLE  11.     TRADEOFF  FOR  PAIR  1,  2 


JATE   615  ID  TC1C--TT 
TRADE.PFT  FSR 
PAIR     J   2 


CeEFF 


• 

364S3 

•  06 

198 

•C8459 

N9 

10 

TY 

ci 

1 

1 

1 

J 

0 

c 

2 

2 

2 

0 

c 

0 

3 

3 

3 

C 

r 

n 

4 

5 

5 

c 

0 

0 

5 

4 

4 

0 

0 

0 

6 

16 

16 

V 

n, 

0 

7 

7 

7 

? 

0 

0 

0 

2 

8 

11 

11 

c 

0 

0 

9 

6 

6 

c 

c 

1* 

10 

10 

10 

0 

0 

Q 

11 

21 

21 

3 

0 

0 

0 

3 

1? 

17 

17 

1 

0 

0 

0 

1 

13 

30 

30 

3 

c 

0 

0 

3 

I* 

12 

12 

2 

0 

c 

0 

2 

15 

9 

9 

2 

0 

c 

0 

? 

16 

13 

13 

2 

0 

c 

0 

? 

17 

34 

^4 

3 

c 

r 

3 

3 

18 

18 

18 

2 

0 

C 

n 

2 

19 

26 

26 

2 

c 

0 

0 

2 

20 

8 

8 

1 

0 

c 

n 

1 

21 

38 

38 

3 

o 

0 

0 

3 

22 

27 

?7 

1 

Q 

0 

o 

1 

23 

H 

1* 

2 

0 

c 

0 

2 

2* 

37 

37 

3 

0 

3 

25 

22 

22 

2 

0 

0 

0 

2 

26 

31 

31 

2 

0 

c 

0 

? 

27 

39 

■59 

3 

G 

c 

c 

3 

28 

23 

23 

2 

0 

0 

0 

2 

29 

19 

19 

2 

0 

c 

0 

2 

30 

35 

35 

2 

c 

c 

0 

2 

31 

32 

32 

2 

0 

0 

0 

2 

32 

28 

?8 

2 

0 

0 

c 

2 

33 

20 

20 

4 

0 

o 

0 

4 

34 

15 

15 

4 

0 

0 

c 

4 

35 

24 

24 

4 

c 

0 

0 

4 

36 

33 

33 

4 

0 

c 

0 

4 

37 

29 

29 

4 

0 

0 

r, 

4 

38 

25 

?5 

4 

0 

c 

0 

4 

39 

36 

36 

4 

0 

0 

n 

4 

const  (4,5)   = 


1.4922+  1.5374 


1.51 
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TABLE  12.     TRADEOFF  FOR  PAIR  1,   2 


JATE       615    ID    TC1C--TT 
TEJADfcPFF    FOR 

^AIR  1       3 


(-8EFF 


• 

3110 

\8 

1 

6 

2 

8 

3 

1 

4 

5 

5 

7 

6 

9 

7 

4 

8 

3 

9 

2 

10 

15 

11 

10 

1? 

1* 

13 

13 

1* 

12 

15 

11 

16 

20 

17 

19 

IP 

25 

19 

2* 

20 

16 

?1 

18 

22 

17 

?3 

23 

24 

29 

25 

22 

26 

28 

27 

21 

28 

33 

29 

27 

30 

36 

31 

26 

32 

32 

33 

31 

34 

35 

35 

30 

36 

3* 

37 

37 

38 

39 

39 

38 

.17789 

. 

•  04 

ID 

TY 

6 

1 

u 

0 

a 

1 

ri 

0 

1 

1 

[j 

0 

5 

1 

C 

0 

7 

? 

0 

0 

9 

2 

<J 

c 

4 

1 

0 

3 

1 

J 

p 

2 

1 

J 

0 

15 

4 

o 

c 

10 

1 

0 

r 

1* 

? 

;i 

c 

13 

2 

£ 

0 

12 

2 

j 

0 

11 

1 

0 

0 

?0 

4 

0 

c 

19 

2 

0 

0 

?5 

4 

0 

JJ 

34 

4 

0 

0 

1  6 

1 

0 

0 

18 

2 

0 

0 

17 

1 

c 

0 

?3 

3 

J 

0 

29 

4 

0 

0 

?? 

2 

0 

0 

38 

2 

0 

0 

?1 

3 

0 

0 

33 

4 

0 

0 

?7 

1 

0 

0 

36 

4 

c 

c 

'6 

2 

0 

c 

32 

2 

0 

o 

31 

2 

0 

0 

35 

2 

J 

0 

30 

3 

V 

0 

3* 

3 

0 

0 

37 

3 

c 

0 

39 

3 

Is 

0 

38 

3 

0 

c 

CL 

SC0RE 

1 

2 

o 

1 

'6404 

1 

2 

1 

6485 

■? 

o 

1 

.6748 

3 

0 

1 

8i  "3 

4 

0 

? 

9-32 

i 

("*" 

? 

-9537 

T> 

r 

1 

9«8l 

5 

o 

1 

0306 

6 

p 

1 

0731 

7 

0 

4 

•  0972 

0 

1 

2590 

9 

n 

2 

'2670 

3 

<"l 

2 

3520 

4 

0 

2 

3944 

5 

0 

1 

-5218 

9 

0 

4 

.5379 

0 

c 

6228 

6 

g 

4 

-6309 

0 

4 
1 

3 

.6733 

10 

0 

7422 

i3 

2 
1 
2 

2- 

1- 

7?02 

11 

7 

0 

8351>^ 

0 

8432 

8 

0 

4 

8512 

0 

2 

8856 

9 

0 

3 

1- 

9786 

10 

0 

2 

0^55 

0 

4 

1 
4 

2 
1- 

2 

0716 

12 

0 

?, 

1060> 

0 

2. 

1221 

0 

2 

2 

1484 

11 

0 

2 

2< 

1989 

0 

2 

3 

2839 

"13 

0 

2 
3 

3 

3 

1- 
2- 
3- 

2 

4;  93  y 

14 

0 

3 

453?>/ 

0 

2 

589i 

0 

2- 

7?46 

0 

3 

2' 

9o24 

0 

3 

2- 

9449 

const  (4,6) 


1.8351  +2.4537 


2.14 
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TABLE  13.     TRADEOFF  FOR  PAIR  1,   4 


L~ATE       615     ID    TCIO-TT 
TRADtTT    F6R 
PAIR  1        4 


LdEft 


?4535 

•  10 

7Q0 

• 

2?7<=4 

N3 

ID 

TY 

:l 

1 

2 

2 

1 

c 

o 

i 

2 

1 

1 

1 

.J 

a 

Q 

i 

3 

3 

3 

1 

o 

A 

l 

4 

5 

5 

1 

0 

c. 

0 

i 

5 

4 

^ 

1 

-. 

o 

£ 

i 

6 

16 

16 

1 

-y 

c 

T 

i 

7 

11 

11 

1 

r\ 

r 

G 

i 

8 

7 

7 

2 

Q 

r 

c 

? 

9 

30 

30 

3 

j 

q 

~ 

3 

10 

21 

21 

3 

o 

r 

3 

11 

10 

10 

1 

c 

c 

1 

1? 

17 

17 

1 

VJ 

r 

0 

1 

13 

6 

6 

1 

0 

C 

r\ 

1 

1* 

3* 

Ik 

3 

o 

c 

0 

3 

15 

12 

12 

2 

.7 

0 

^ 

V 

2 

16 

38 

38 

3 

j 

0 

0 

3 

17 

26 

?6 

2 

c 

c 

n 

? 

18 

18 

18 

2 

0 

0 

C 

2 

19 

13 

13 

2 

^ 

u 

0 

2 

20 

9 

9 

2 

u 

0 

c 

2 

21 

37 

37 

3 

c 

0 

Q 

3 

22 

39 

39 

3 

0 

r* 

rj 

3 

23 

27 

?7 

1 

c 

Q 

1 

2* 

31 

31 

2 

L 

G 

r> 

? 

25 

22 

?2 

? 

0 

0 

0 

2 

26 

1* 

1* 

2 

0 

0 

c 

2 

27 

23 

?3 

2 

0 

Q 

n 

2 

28 

8 

8 

1 

0 

Q 

0 

1 

29 

35 

35 

2 

0 

^ 

0 

2 

30 

19 

19 

2 

0 

n 

0 

2 

31 

32 

32 

2 

J 

C 

A 

2 

32 

28 

'8 

9 

J 

Q 

r* 

? 

33 

20 

20 

4 

\J 

3 

0 

4 

3* 

15 

15 

4 

G 

c 

0 

4 

35 

33 

33 

4 

0 

0 

4 

36 

24 

?4 

4 

0 

c 

r\ 

4 

37 

29 

29 

4 

c 

0 

0 

4 

38 

25 

25 

4 

G 

0 

0 

4 

39 

36 

36 

4 

0 

0 

0 

4 

3LC 

3726 

3R61 

6n0l 

7?06 

S?76 

1  < 

02*1 

1 ' 

I486 

1« 

2827 

1  < 

4561 

1  - 

4696 

1< 

4967 

1- 

5902 

1 

6308 

1 

-7906 

1 

'8312 

? 

O046 

2 

'0317 

p 

>0453 

2 

Oc** 

2 

-0723 

2 

•  1252 

p 

•  2322 

■? 

.2593 

P 

.3663 

"5 

•  3798 

P 

•5;39 

? 

.6-73 

0   ? 

•6479^ 

u    ? 

«7iC8 

2 

.7P79 

2 

.8213 

0   ? 

.9419 

0   3 

•1829; 

3 

•  4?4C 

3 

•  5-39 

3 

•  5i75 

3 

•  6'45 

3 

.7450 

4 

•  2935 

8 

9 

10 


const  (4,7)  = 


2.6479  +  3.1829 


=  2.92 
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TABLE  14.     TRADEOFF  FOR  PAIR  2,   3 


JATE 

61*  ID 

TC1C 

--TT 

TRADLPFT  FAR 

PAIR 

2   3 

CBEFP 

2« 

96373 

.0*507 

• 

•1475* 

Ne 

ID 

TV 

Cl 

scbre 

G   1 

P 

3 

4 

1 

15 

15 

4 

0 

0 

0 

4 

'1111 

1 

2 

36 

36 

4 

j 

0 

o 

4 

2339 

P 

3 

25 

?5 

4 

- 

0 

0 

4 

2*63 

-3 

4 

8 

8 

1 

j 

0 

c 

1 

i7ir. 

1 

5 

2* 

P4 

4 

0 

0 

4 

'3q3« 

4 

6 

29 

29 

4 

u 

c 

o 

4 

-43*9 

5 

7 

20 

20 

4 

J 

r 

'\ 

4 

■  4963 

*- 

8 

33 

33 

4 

0 

C 

o 

4 

.6-515 

7 

9 

I* 

1* 

2 

■j 

0 

v. 

? 

-7:13 

1 

10 

9 

9 

2 

J 

0 

r\ 

? 

75^7 

p 

11 

19 

19 

2 

j 

0 

0 

2 

791* 

3 

1? 

6 

6 

1 

-•\ 

0 

0 

1 

•8161 

2 

13 

28 

?8 

2 

•^ 

0 

0 

2 

8815 

4 

I* 

23 

?3 

2 

c 

0 

0 

2 

9R*0 

5 

15 

13 

13 

2 

0 

0 

0 

2 

996* 

6 

16 

32 

32 

2 

n 

0 

*\ 

2 

? 

-07*1 

7 

17 

22 

?2 

2 

0 

0 

0 

2 

2 

1316 

S 

18 

12 

1? 

p 

c 

0 

0 

2 

p 

.1439 

9 

19 

7 

7 

2 

0 

0 

0 

2 

2 

-1562 

10 

20 

18 

18 

2 

0 

c 

0 

2 

2- 

234C 

11 

21 

10 

10 

1 

0 

0 

0 

1 

P. 

?464 

3 

22 

35 

35 

2 

c 

0 

0 

2 

?« 

2668 

12 

23 

27 

?7 

1 

0 

0 

0 

1 

p , 

32*2 

4 

2* 

31 

31 

? 

0 

c 

0 

2 

?. 

3ft92 

13 

25 

5 

5 

1 

ft 

0 

0 

1 

2. 

4i63 

5 

26 

4 

4 

1 

0 

c 

0 

1 

?< 

4513 

6 

27 

26 

1 

17 

?6 

1 
17 

P 
1 
1 

c 

0 

0 
0 
0 

0 

n 

0 

2 
1 
1 

0   ? 

471  7>- 

~~  7~ 
3 

1* 

1  const  (5,6) 

28 
29 

U   2- 

2 

5.^1 

5291 

2.4717  +  2.7217 
2 

30 

11 

11 

1 

0 

c 

c 

1 

P, 

5«65 

9 

'J 

31 

3 

21 

3 

21 

1 
3 

c 

0 

0 

n, 

c 
c 

1 
3 

0   ?1 

5989 

1 

=  2.60 

32 

? 

721  7>- 

33 

2 

2 

1 

0 

D 

c 

1 

2< 

746* 

11 

3* 

37 

37 

3 

0 

0 

0 

3 

2< 

7545 

c 

35 

16 

16 

1 

c 

'v. 

1 

2< 

7792 

12 

36 

39 

39 

3 

^ 
u 

0 

0 

3 

2- 

7995 

3 

37 

3* 

34 

3 

0 

0 

0 

3 

2< 

8569 

4 

38 

38 

38 

3 

c 

0 

3 

3 

P 

9471 

5 

39 

30 

30 

3 

0 

c 

0 

3 

2- 

9594 

6 
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TABLE  15.     TRADEOFF  FOR  PAIR  2,   4 


-ATE       bl5     ID    TC1C- 
TWADL^tFF    Pnp 
^AJR  ?       4 


•TT 


.gE^F 


-• 

69355 

•00396 

•305f7 

N6 

ID  TY 

Cl. 

SCP3F 

0  1 

2 

3 

4 

1 

2 

2   1 

j 

£ 

o 

1 

•2433 

1 

2 

1 

1   1 

j 

,-i 

Q 

1 

•5410 

2 

3 

3 

3   1 

J 

ij 

? 

1 

•  54«9 

3 

4 

16 

16   1 

C 

c 

- 

1 

•  5648 

4 

5 

30 

~0   3 

0 

r 

c 

•  5>:06 

1 

6 

5 

5   1 

J, 

0 

r 

1 

•85Q7 

5 

7 

4 

4   1 

0 

j 

0 

1 

•  8546 

6 

8 

11 

1  1   1 

J 

0 

o 

1 

•8665 

7 

9 

21 

21   3 

J 

u 

~> 

3 

•  8784 

2 

10 

31 

34   3 

tj 

c 

c 

3 

•8902 

3 

11 

38 

38   3 

0 

0 

0 

3 

•  8982 

4 

1? 

17 

17   1 

;> 

r 

^ 

1 

1 

i.iaol 

3 

13 

37 

37   3 

o 

o 

3 

1 

•  1999 

c 

1* 

39 

59   3 

j 

0 

0 

3 

1 

•2q3? 

6 

15 

7 

7   2 

q 

C 

o 

2 

1 

•  4660 

1 

16 

10 

10   1 

0 

0' 

.1 

1 

1 

•4739 

9 

17 

26 

?6   2 

u 

I 

0 

2 

1 

.4037 

2 

18 

12 

12   2 

l) 

Q 

Q 

2 

1 

■  7835 

3 

19 

18 

18   ? 

U 

n 

n 

2 

1 

.7=114 

4 

20 

27 

27   1 

*1 

c 

0 

1 

1 

7993 

10 

21 

31 

31   2 

0 

0 

fj 

2 

1 

8-33 

5 

22 

6 

6   1 

o 

0 

o 

1 

2 

0733 

11 

23 

13 

13   2 

J 

o 

n 

? 

? 

0892 

6 

24 

22 

22   2 

0 

o 

0 

2 

2 

loll 

7 

25 

35 

35   2 

0 

c 

0 

3 

? 

1129 

8 

26 

9 

9   2 

0 

c 

Q 

2 

?  < 

3»69 

9 

27 

?3 

23   2 

G 

0 

Q 

2 

?, 

4-67 

10 

28 

32 

32   2 

0 

0 

-\ 

2 

5 , 

4147 

11 

29 

14 

14   2 

0 

c 

o 

? 

2. 

7-^05 

12 

30 
31 

19 
28 
8 
20 
33 

19   2 

28   2 
8   1 

0 

c 

?. 

7o84 

13 

^ 

0 
0 

c 

c 

0 

2 
1 

0?( 

71 64>- 

12 

14 

J 

3? 
33 

3* 

°,?' 

3^00 

const  (5,7)  = 

20   4 
33   4 

0 

Q 

c 

o 

o 

* 
4 

3< 
3. 

3l  98/>- 
3317 

1 
2 

= 

35 

24 

24   4 

0 

!"l 

0 

4 

3. 

6294 

3 

36 

29 

29   4 

c 

0 

0 

4 

3. 

6334 

4 

37 

15 

15   4 

0 

c 

0 

4 

3. 

9232 

5 

38 

25 

25   4 

0 

c 

0 

4 

3  t 

9351 

6 

39 

36 

36   4 

0 

0 

0 

4 

4. 

2527 

7 

2.7164  +  3.3198 


=  3.02 
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TABLE  16.     TRADEOFF  FOR  PAIR  3,  4 


JAT'E   615  ID 

TC1C 

--T'T 

TRADtSFF  F9R 

DAIR     3   4 

LeE^f- 

2»774?9 

-.Q1938 

•  1C-G'  Q 

N6 

T  ;; 

TY 

a 

SC0RF        0 

1 

2 

3 

4 

1   3G 

3  0 

3 

1  j 

', 

0 

3 

2« 

9227 

1 

2   3? 

58 

? 

(\ 

o 

T 

2  ■ 

9*47 

2 

3    2 

2 

1 

o 

r 

1 

2< 

■4777 

*   16 

16 

1 

r 

1 

3. 

ICO  3 

p 

5   34 

3  4 

3 

r, 

o 

3 

3  , 

0-35 

3 

6   21 

'1 

3 

0 

0 

3 

3  , 

0'-l6 

4 

7   39 

3  9 

3 

0 

- 

T 

3  . 

064? 

5 

8    3 

3 

1 

o 

r 

1 

3. 

0778 

3 

9   37 

37 

1 

3 
1 

- 

0 

r 

r 

3 
1 

n  ?' 

0?4  2X 

4 

6 

10    1 

0  3. 

1165   \ 

il   11 

1  1 

1 

0 

0 

1 

3. 

1  i  97 

N£", 

\?         4 

4 

1 

2 

1 

1 

3  , 

1779 

A- 

13   17 

17 

1 

0 

r 

1 

3, 

1?11 

7 

1*    5 

5 

1 

0 

o 

1 

3. 

1972 

5 

15   26 

26 

2 

\j 

0 

? 

3  < 

?424 

i 

16   31 

31 

2 

c 

0 

o 

p 

3 

3231 

2 

N."\ 

17   10 

10 

1 

o 

0 

c 

1 

3 

3393 

9 

18   27 

?7 

1 

j 

o 

'^ 

1 

3 

34?5 

1C 

const  (6,7) 

19    7 

7 

2 

c 

0 

2 

3 

3781 

3 

20   18 

18 

2 

rj 

0 

0 

p 

3 

3«13 

4 

21   35 

35 

2 

j 

-  n 

r» 

2 

3 

4-38 

5 

22   12 

1? 

2 

o 

0 

2 

3 

4200 

6 

23   22 

'2 

2 

v 

0 

0 

p 

3 

462C 

7 

2^   13 

13 

2 

o 

Q 

? 

3 

5201 

£ 

25   32 

32 

2 

n 

0 

2 

3 

.5233 

9/ 

26   23 

?3 

2 

C; 

0 

c 

r 

3 

5621 

l/ 

27    6 

6 

1 

0 

0 

0 

1 

3 

.5976 

11 

28   28 

?8 

2 

0 

o 

c 

2 

3 

.6428 

11 

29    9 

9 

2 

0 

c 

c 

2 

3 

>659C 

12 

30   19 

19 

2 

0 

G 

0 

2 

3 

.6815   . 

13 

31   l* 

14 
33 

2 
4 

0 

0 
C 

0 
0 

2 
4 

0  3 

■7??3  / 

14 

1 

3?   33 

°  3 

.8236/ 

33   20 

20 

4 

'J 

<j 

0 

4 

3 

•  881  7 

2 

34   29 

39 

4 

c 

0 

0 

4 

3 

.9431 

3 

35   24 

?4 

1 

0 

c 

4 

3 

.9624 

4 

36    8 

8 

1 

0 

0 

0 

1 

3 

.97^6 

12 

37   25 

?5 

4 

c 

0 

c 

4 

4 

■  C625 

5 

38   36 

36 

4 

0 

0 

c 

4 

4 

■  lo*5 

6 

39'  15 

15 

4 

c 

0 

0 

4 

4 

'120? 

7 

3.0842  +  3.8236 

2 
3.45 
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CTC 


From  Equations  (27)  and  (28),    the  values  of  W„..   "  are  computed,   using 


CTC 

W~..      and  const(i,  i),   as 
Oij  J 


WCTC    =    ^CTC    +(jonst(ifi) 

Oij  Oij  'J/ 


Thus, 


(i.j) 

CTC 
0!J 

const(i,  j) 

CTC 

0»J 

1,2 

0.  3648 

1.  51 

1.  145 

1,3 

0.  311 

2.  144 

1.  833 

1,4 

-0.  845 

2.92 

3.765 

2,3 

2.  964 

2.  60 

-0. 364 

2,4 

-0. 6936 

3.  02 

3.  714 

3,4 

2.  774 

3.45 

0.  676       . 

The  coefficients  are  normalized  as  discussed  in  Appendix  A  to  get  direction 
numbers  and  distance  from  origin  for  each  discriminant: 


(i,j) 

ll^ll. 

CTC  n 

iij 

CTC  n 
<W2ip 

CTC  n 
<W0iP 

(1,2) 

0.  105 

0.  59 

0.  81 

10.  9 

(1,3) 

0.  183 

0.  97 

-0.  23 

10.  02 

(1,4) 

0.  251 

0.43 

0.  91 

15.  0 

(2,3) 

0.  154 

0.  29 

-0.  96 

-    2.  364 

(2,4) 

0.  306 

-0. 013 

0.  999 

12.  14 

(3,4) 

0.  102 

-0.  19 

0.  981 

6.  63 
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where 


w<fcHl 


CTC  CTC 

113  213 


1/2 


CTC 
(W,  .       ) 

ki] 


n 


CTC 


11 


k  =  0,  1,  2 


and 


rCTC 


n 


d(o,w)  =   I(Wq^)  I 


Using  the  foregoing  table,    the  linear  discriminants  are  plotted  in  Figures 
9-a  and  9-b. 

The  piecewise  linear  discriminants  are  those  separating  classes  1,   2  from 
old  class  C,  (C„  and  C.  comprise  old  class  C„);  they  are  shown  as  heavy 
dashed  lines  in  Figure  8.     Note,   as  discussed  in  Appendix  B,    the  discriminant 
for  class-pair  C„  and  C.  is  not  needed  (only  the  original  three  classes  are  of 
interest). 

The  linear  discriminants  for  the  extended  problem  are  plotted  in  Figure  9-b  in 
solid  straight  lines.     Note  that  the  discriminant  for  sub-class  pair  (1,  3)  was 
chosen  using  the  maximum  interval  to  compute  const(l,  3).     This  choice 
arose  from  the  uncertainty  as  to  the  representativeness  of  the  type  6  data, 
since  so  few  points  comprise  the  class.     The  data  point  #27  is  far  re- 
moved from  the  rest  of  the  class  and,    since  the  data  for  type  4  are  repre- 
sentative,   can  be  considered  as  an  anamolous  point.     Thus,   points  #21  and 
#27  were  ignored  in  choosing  const(l,  3).     The  highly  localized  density  of 
the  rest  of  type  6  suggests  representativeness,   even  though  the  ~T7  =  t^z  ratio 
is  small;   thus  these  points  were  used  to  characterize  type  6. 
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FEATURE  2 


NOT 

NEEDED  SINCE.,  , 

4,3  ARE  SUB-2". 

CLASSES 

OFCLA 


*•  FEATURE  1 


F  igure  9.     Linear  Discriminants  for  Extended  Example 
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3.  3.  3    The  Layered  Machine  Classifier 
Now  that  the  piecewise  linear  discriminants 

C. 

A..(X)    -    -W.    .    .  +  W,    .    .  X,  +  W„    .    .  Xn   ^      0 
13  0,1,3  1,1,3      1  2,1,3      2   < 

c. 

1 

have  been  determined  with  (i,  3)  =(1,2),   (1,3),   (1,4),   (2,3),   (2,4),   for  the 
three-class  problem,   we  are  interested  in  using  them  to  classify  new  data 
points  whose  class  membership  is  not  known  ahead  of  time.     From  the 
expression  for  A..(X),   we  know  that  C.  lies  on  the  positive  side  of  the  linear 
discriminant  and  C.  on  the  negative  side  (see  Figure  9b).     Further,   each 
A..(X),   for  a  given  X,   allows  us  to  remove  a  class  from  consideration;  i.  e.  , 

e'  =  [C^,   C'2,   Cj,    C'4)  and  remembering  that  C^  =  C  '     C     =  C'  , 
C3  =  C3  VC4  , 


A.  .(X)  >  0  =*  Xs   one  of  e  '  -  [C  '} 

A.  .(X)  <  0  =»  Xs  one  of  e  '  -  [C  '  ] 
i]  3 


Define  the  Boolean  variable 


(   1  ;  A    (X)  >  0 

B    (X)    =  ^ 

13  0  ;  A..(X)  <  0 

L3 


for    each  A..,    (i,j)  =  (l,  2),    (1,3),   (1,4),   (2,3),   and  (2,4). 
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Then 


B    (X)  =    1    =>   Xee'-  {C/ } 

J 

B..(X)  =    0    =>    Xee'-[C.'] 
!3  3 


and  we  can  use  the  B..(X)  to  determine  the  class  membership  of  X.     This 
is  done  by  using  the  truth  table  for  the  B..(X):     (e  =  {C..,  C~,  C„}) 

J 


(i,j) 

B..  =  1 

B..  =  0 

(1,2) 

e  -  [Cj]  =  [C2, 

C3] 

e  -  {C2}  =  [CrC3) 

(1,3) 

Cc2,c3} 

[crc2] 

(1,4) 

tC2'fc3? 

i^/Cg] 

(2,3) 

{crc3} 

[crc2] 

(2,4) 

{crc33 

Ccrc2] 

From  the  truth  table,   if  B..  =  0  for  each  (i,  j)  pair,  we  conclude 

J 


Xe  CCrC3}    and    C^.Cg} 


or 


Xe  {C1,C3}    A    {CrC23    =    {Cj} 


Thus,  we  must  conclude  XeC... 
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Similarly,    if 


B-    .    =    0,  j  =  2,3,4 

x>  J 


and 


B2    •    =    1,  j=3;  4 


X 


c  Celfc8]  a  {crc2}  =  {Cj} 


Thus,  we  can  define  the  Boolean  function  F„  (X)  such  that 

Cl 

1    ,     XeC1 
Fr(X)    = 
W  (  0    ,     XeCx 


as 


Fc  (X)    =    Bj    2(X)  A  B2    3(X)  A  fi      x(X)  A  (AVB) 


A=    (B2,3AB2,4)V(B23AB24) 


B  =    (B23  A  B24>  V  (B23  A  B24>       > 


hence,  AVB    =    1 
and 


F^.(X)    =    BU(X)AB1   3(X)AB14(X)    (=FC(X))    . 
By  analyzing  the  truth  table  in  a  similar  manner  as  for  Fp  (X)  ,  we  determine 


F^.(X)    =    B12(X)  AB23(X)  AB24(X)       (=FC(X)) 
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Fn  (X)    =    F  '    V  F  '    (X) 
^3  ^3  W 


(B13(X)  A  B23(X))  V    (B14(X)  A    B24(X)) 


Using  the  Fp  (X),  we  can  classify  X  by  the  following  table. 


Fc 
■1 

F 

c 

F 
C 
^3 

X  in  class 

1 

0 

0 

ci 

0 

1 

0 

C2 

0 

0 

1 

C3 

0 

Note  that  with  reference  to  Figure  9b, 


Fr  (X)  =  1    =»   X  falls  in  one  of  regions  X,   IX,  VIII 

Fn  (X)  =  1    =»   X  falls  in  one  of  regions  I,  XIV,   V,   IV 
^2 

F^  (X)  =  1    =»   X  falls  in  one  of  regions  II,   III,  XV,   VI,  XII,  XIU, 
U3 

hence  the  F^    define  disjoint  regions  of  the  space,   and  if  one  of  the  Fp    is 

i  i__ 

true  (  =  1),   the  others  must  be  false  (=0).     Thus,   Fn  (X)  =  F^  (X)  V  Fr  (X). 

^3  ^1  2 


Using  this  fact,   a  schematic  for  the  classifier  is  given  in  Figure  10,   com- 
puting F^   (X)  using  Fr  (X)  and  F^  (X).     In  the  figure, 
^3  W  U2 
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d      e       f 


g  =  +  ad  +  be  +  cf 


i 


THRESHOLD 


T 


h  = 


1,9  2-T 
0,g<T 


The  classifier  in  Figure  10  is  termed  a  layered  machine  classifier,   since 
the  computation  is  carried  out  in  successive  stages  or  layers: 


layer  1 
layer  2 
layer  3 
layer  4 


A.  .(X)  computation 
threshold  decision 
Boolean  function  computation 
encoded  classification  of  X. 


Figure  11  shows  a  flow  chart  for  performing  the  same  operations  in  soft- 
ware. | 

In 'general,   the  design  of  the  layered  machine  classifier  can  be  carried  out 
just  as  done  for  our  simple  example; 


N 


i-1 


F'    (X)    =    (A        B.,(X))  A  (A     B..(X)) 
j=i+l      iJ  j  =  i      J1 


(i,j)£L 


(j,i)£L 


with  each 
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T=0   T 


INPUT  DATA 
POINT  X 


—  LOGICAL  NOT 

—  LOGICAL  AND 

—  LOGICAL  OR 


Figure  10.     Hardware  Logic  Implementation  of  Piecewise 
Linear  Classifier 
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M 


1-0 


I  *- 1  +  1 
J*- 1 


J*-  J  +  1 


I 


d|LJ(X)=WllJXl+W2UX2-WCU 


B,j=TRUE 


NO 


NO 


NO 


BU=FALSE 


Fr   =  Fr  uF. 
°3       Ll       c2 


OUTPUT  CLASS  CODE 

L>n         V/o        ^^ 


Fr      Fr      Fr      CLASS 


I 

0 

0 

cl 

0 

1 

0 

c2 

0 

0 

1 

c3 

Figure  11,     Flow  Chart  Corresponding  to  Figure  10 
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B    (X)    = 


1     ;      A.  (X)  >  0 

J 


0    ;      A..(X)  <  0 


where  for  (i,  j)  pairs  such  that  A..(X)  is  not  needed  (as  is  the  case  for  AoA(X) 
in  our  example  problem)  we  define  L  =  {(i,  j)  j  . 


One  defect  of  this  approach  to  the  F  '     (X)  is  that  the  resulting  Boolean  func- 

3 
tions  are  not  necessarily  minimal.     Thus,    the  CTC  program  includes  a 

logical  mode  whose  output  can  be  used  to  determine  minimal  expressions 
Fr  (X)  using  the  F '  (X)  as  a  guide.     This  minimization  procedure  is  dis- 
cussed in  Chapter  4,^  CTC  Operation,   and  is  based  on  the  Karnaugh  mapping 
technique. 


3.  4    INTERACTIVE  DESIGN  OF  CLASSIFIERS 

The  classifier  design  example  of  the  previous  section  was  carried  out  using 
the  following  sequence  of  steps: 

1)  Analyze  the  labeled  samples  and  the  results  from  previous 
attempts  at  classification  that  were  not  satisfactory. 

2)  (i)  Based  on  the  analysis  in  (1),   define  new  subclasses, 
consolidate  old  ones,   etc.   and  design  a  new  classifier,   or 

(ii)  Decide,   on  the  basis  of  dimensionality  tests  and  previous 
classification  attempts  to  try  different  features  or  to  collect 
more  labeled  samples  (or  both). 

3)  Iterate  on  (1)  and  (2)  until  a  satisfactory  classifier  is  designed 
or  until  enough  failures  warrant  a  redesign  of  the  measure- 
ment system  (for  example,   one  might  have  to  try  a  number 
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of  sensors  for  vehicle  detection  before  the  successful 
inductive  loop/phase  modulator  sensing  system  is 
discovered). 

The  foregoing  design  method  requires  intelligent  (human)  interaction  with 
the  classifier  design  program.     The  interaction  is  in  the  form  of  analyzing 
program  results  and  making  the  necessary  program  control  decisions. 
For  the  CTC  program,    input  cards  control  the  program  (see  Chapter  4), 
while  line  printer  output  provides  the  data  for  analyzing  (i.  e.  ,   property 
listings  of  classifier  results,   projections,   statistics)  dimensionality,    com- 
plexity,  and  error  rates. 

The  overall  process  of  iteratively  studying  the  data  and  trying  many  classi- 
fier designs  provides  a  vehicle  for  familiarizing  the  designer  with  a  specific 
data  set  in  a  specific  feature  space.     This  familiarization  process  provides 
the  basis  for  making  control  decisions  such  as  2-ii.     Note  that  the  resulting 
classifier  is  not  necessarily  one  deemed  optimal  by  results  of  statistical 
theory  (see  Appendices  A,  B).     Its  merit  is  that  a  large  degree  of  human  knowl- 
edge has,   by  the  interactive  process,   been  incorporated  in  the  final  design. 

Since  the  major  cost  of  solving  a  pattern  recognition  problem  is  usually  for 
collecting  the  labeled  samples',    the  cost  of  computer  time  required  by  an 
interactive  design  process  is  a  small  consideration.     Further,   and  more  to 
the  point,    in  many  pattern  recognition  problems,    the  human  is  the  standard 
(recall  the  discussion  of  using  'humps'  in  phase-versus-time  plots  as  fea- 
tures,  from  Chapter  1).     He  should  be  put  in  charge  of  the  classifier  design 
and  evaluation,   and  in  control  of  automated  aids  for  the  design  and  evalua- 
tion process  (i.  e.  ,    the  CTC  program). 


For  example,    collecting  data  for  various  vehicles  in  the  data  set  used  to 
design  the  bus  classification  required:    1)  drivers  and  vehicles,   2)  the 
design  and  construction  of  a  prototype  sensor  system  (inductive  loop- 
phase  modulation  detection),   and  3)  data  recording  equipment  and  a  careful 
monitoring  of  experiments  for  labelling  purposes. 
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Finally,    the  interactive  design  approach,   while  removing  the  need  for 
laborious  computations  and  data  bookkeeping,   gets  the  most  information 
from  an  expensive  data  set.     (Note  how  a  relatively  small  number  of 
samples  was  used  to  determine  a  satisfactory  classifier  in  the  previous 
section. ) 


3.  5    THE  CTC  PHILOSOPHY 

The  CTC  program  was  developed  using  the  following  guidelines: 

1)  Human  standards  and  judgment  are  vital  to  the  design  of 
successful  recognition  systems. 

2)  One  should  not  attempt  to  deify  techniques  that  have  worked 
for  specific  problems;  future  developments  will  have  to  be 
incorporated  in  any  interactive  system  that  is  to  lead  a 
useful  life.     The  system  must  be  flexible  to  be  useful  for 
more  than  one  problem. 

Thus,   the  CTC  program,   at  its  inception,  was  designed: 

1)  For  interactive  use. 

2)  (i)  So  that  a  wide  variety  of  data  may  be  used.     For  the 

bus  detector  design,   CTC  was  used  first  to  separate  moving 
from  stopped  vehicles  and  then  again  to  design  a  classifier 
for  moving  vehicles. 

In  addition,    the  CTC  has  also  been  used  in  classifying  image 
segments  to  develop  the  Honeywell  Autoscreener. 
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(ii)  So  that  the  CTC  program  is  modular  in  form,   allowing 
an  alteration  of  classifier  techniques  and  an  introduction  of 
new  data  analysis  subroutines  without  requiring  drastic  re- 
vision of  the  driving  program  and  existing  subroutines. 

Finally,    the  hierarchical  approach  to  problem  solving  provides  the  philosophy 
guiding  the  use  of  the  CTC  program. 

The  Hierarchical  approach  to  problem  solving  is  simply:    for  a  difficult 
problem,  attempt  to  'break-up'  the  problem  into  sub-problems  which  are 
more  easily  solved,  and  then  combine  these  individual  solutions  to  solve  the 
original  problem. 

The  procedure  is  illustrated  in  Chapter  2.       Rather  than  attempt  a  piece- 
wise  linear  discriminant  solution  directly  (such  techniques  are  known-see 
Meisel),  we  solved  a  collection  of  linear  discriminant  sub-problems,  and, 
using  Boolean  algebra,   combine  the  results  into  a  way  giving  a  piecewise 
linear  solution  to  the  problem  originally  of  interest.     The  name  Cascaded 
Threshold  Classifier  is  an  allusion  to  the  resulting  classifier  form  (when 
solved  hierarchically).     From  Figure  10  we  see  a  cascade  of  decision  layers: 
first  the  linear  discriminant  decisions,   then  the  Boolean  decision  network 
operating  on  the  linear  discriminant  decisions.     The  overall  solution  for  the 
bus  classifier  is  also  hierarchic.     We  first  classify  moving  vehicles  versus 
non-moving  vehicles,   and  then  classify  moving  vehicles  as  "bus"  or  "non- 
bus".     Each  stage  uses  a  CTC-structure  classifier,   such  as  shown  in 
Figure  10. 
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CHAPTER  4 

DATA  CARDS  AND  CONTROL  CARDS 
USED  IN  THE  CTC  PROGRAM 


The  Cascaded  Threshold  Classifier  (CTC)  program  obtains  its  data  and  its 
direction  from  input  cards.     This  chapter  describes  the  data  and  control  card 
formats,  their  functions  and  how  they  interract  when  used  together.     Two  ex- 
amples are  given  at  the  end  of  the  chapter  to  show  how  typical  problems  can 
be  solved  using  CTC. 

In  essence,  the  CTC  program  is  a  collection  of  data-processing  and  data  list- 
ing subprograms.     A  control  card  deck  is  used  to  select  which  subprograms 
are  used  and  to  control  their  operation.     For  a  single  "run,  "  all  control  cards 
are  read  before  any  processing  operations  take  place.     Thus,   with  one  ex- 
ception, the  order  of  the  cards  in  the  control  deck  is  not  important.  *    Each 
kind  of  control  card  selects  one  of  the  processing  or  listing  options.     The 
number  punched  in  the  first  three  columns  of  the  card  specifies  the  kind  of 
control  card  it  is;  thus  building  a  control  card  deck  is  like  writing  a  computer 
program  -  each  control  card  contains  one  instruction  with  the  operation  code 
being  given  by  the  number  in  the  first  three  columns  and  the  remaining  col- 
umns telling  how  the  operation  is  to  be  performed. 

Data  are  also  input  on  cards.     There  are  seven  different  types  of  data  cards, 
and,   like  the  control  cards,  the  different  types  are  identified  by  the  number 
appearing  in  the  first  three  columns  of  the  card.     There  are  two  categories 
of  data  that  are  input  on  data  cards  -  parameter  values  and  experimental 
data.     Parameter  cards  contain  coefficients,   probability  values,   the  number 


The  exception  is  the  -99  card  (Execute  card),   which  is  always  the  last  card 
of  a  deck. 
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of  samples  per  class,   subclass  combination  rules  and  feature  selection  para- 
meters.    These  parameters  are  used  in  performing  the  functions  selected  by 
the  control  cards.     The  experimental  data  cards  contain  the  feature  values 
and  identifying  information  (such  as  data  type,  sample  number,  etc.  ). 

Any  card  that  is  blank  or  has  only  zeros  in  the  first  three  columns  is  ignored 
by  the  program,  regardless  of  what  appears  in  the  remaining  columns.  This 
allows  the  user  to  include  comments  in  the  input  deck. 

Each  deck  of  control  and  data  cards  ends  with  a  card  having  -99  in  the  first 
three  columns.     When  a  -99  card  is  read  by  the  program,  the  program  exe- 
cutes the  selected  functions  using  the  data  that  was  input  or  specified  by  the 
deck.     When  all  the  functions  have  been  finished,  the  program  returns  to  the 
card  reader  and  will  read  and  execute  another  input  deck  if  one  is  present. 
In  executing  successive  desks,  the  program  has  options  to  (1)  use  data  that 
have  been  transformed  by  previous  decks,   (2)  restore  the  original  data,   (3) 
append  new  data  to  that  already  in  the  computer,   (4)  clear  and  load  new  data. 

The  next  two  subsections  of  this  chapter  describe  the  data  cards  and  the  con- 
trol cards.     The  following  section  presents  a  tailored  example  of  classifying 
a  set  of  two-dimensional  data.   The  input  deck,   containing  the  control  cards 
and  data  cards,   and  the  resulting  computer  output  are  shown.     The  final  sub- 
section is  another  example  which  was  constructed  by  appending  a  third  fea- 
ture value  to  each  of  the  feature  vectors  used  in  the  first  example.     This  ex- 
ample shows  how  additional  features  can  improve  the  classification  accuracy. 

Table  17  summarizes  the  control  and  data  card  function.     Table  18  describes 
the  card  format  in  detail  and  should  be  useful  as  a  quick  reference  when  using 
the  CTC  program. 
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DATA  CARD  FORMATS  AND  CONTENTS 


Background 

The  first  three  character  positions  (first  three  columns)  on  any  input  card 
are  taken  together  as  a  single  data  field,    as  one  item  of  data.     The  content 
of  this  first  field  indicates  the  function  of  the  card  and  designates  the  use  to 
be  made  of  other  information  on  the  card      Generally,    a  positive  function 
cods  in  this  first  field  indicates  a  data  card,   while  negative  function  codes 
are  used  for  program  control  cards.     Any  blanks  or  spaces  in  this  first  field 
are  read  as  zeroes  by  the  program;  thus  care  must  be  taken  to  ensure  proper 
interpretation  of  function  codes  in  this  first  field.     Excepting  "minus  one" 
cards,    column  four  is  always  blank.     Field  two  of  any  card  (except  a  "minus 
one"  card)  starts  with  the  first  non-blank  character  after  column  four  and 
ends  with  the  first  comma  or  blank  character  which  follows  a  digit  or  a 
decimal  point  after  column  four.     Field  three  starts  with  the  first  non-blank 
character  after  field  two  and  ends  with  the  first  comma  or  blank  character 
which  follows  a  digit  or  a  decimal  point  after  field  four.     Other  fields  are 
similarly  delimited  by  comma  characters  or  blanks;  this  is  known  as 
"widthless"  field  specification.     Fields  which  contain  no  values,    empty 
fields,   can  be  punched  with  no  columns  in  the  field.     Thus  an  empty  field  can 
be  represented  by  commas  in  adjacent  card  columns.     An  empty  field  is  read 
as  a  field  containing  the  number  zero.     Comma  characters  and  decimal  point 
characters  are  not  permitted  in  the  first  three  card  columns. 

The  illustration  below  shows  three  ways  that  the  same  data  can  be  input  using 
the  "widthless"  format  specification. 


001    38,3,5,,,,  16,5,8, 10,2 


01    38  3  5  0  0  0  16  5  8  10  2 
1    38  3    5,  ,  ,  ,  16,    5,8,10,    2 
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"One"  Card  Format 

A  "one"  card  has  a  function  code  of  one,  which  may  be  punched  in  the  first 
field  as  001  or  bbl  or  bOl  or  Obi  where  b  signifies  the  character  blank  or 
space.     A  "one"  card  function  code  may  not  be  punched  as  01b  or  lbb  or  bib 
or  010  or  100  since  these  would  be  read  by  the  program  as  "ten"  or  "one  hun- 
dred. "    "One"  cards  are  used  to  specify  feature  vectors  to  the  program.     The 
second  field  of  the  "one"  card  contains  a  unique  number,   chosen  by  the  user, 
to  identify  the  feature  vector  being  specified.     Field  three  contains  a  number 
less  than  21  which  identifies  the  "type"  of  the  vector.     A  single  type-number 
may  be  used  on  more  than  one  feature  vector.     The  fourth  field  should  con- 
tain a  number  which  equals  the  quantity*  of  features  in  the  feature  vector. 
If  this  value  is  greater  than  10,  the  program  will  use  only  the  first  10  fea- 
tures in  the  vector.     Field  five  is  used  for  another  arbitrary  identifying  num- 
ber,  although  this  number  may  be  the  same  as  the  value  in  field  two.     Field 
six  is  empty  (Empty  fields  should  be  punched  as  described  previously).     Field 
seven  is  used  only  if  secondary  feature  transformation  is  desired,  (see  dis- 
cussion of  "minus  six"  card).     Future  versions  of  the  program  may  make  use 
of  fields  six  and  seven,  but  for  now  they  are  unused.     Field  eight  should  con- 
tain the  first  feature  of  the  feature  vector.     Field  nine  contains  the  second 
feature,   field  ten  the  third,   and  so  on,   until  the  end  of  the  card  (of  course, 
only  the  quantity  of  features  indicated  in  rield  four  will  be  used  by  the  pro- 
gram,   and  in  no  case  will  more  than  10  features  be  used).     Feature  values 
in  any  feature  vector  are  integers.     If  a  non-integer  value  (such  as  5.  87  8) 
is  punched  into  a  card  field  to  indicate  a  feature  value,   the  value  will  be  trun- 
cated to  an  integer  (5.  878  is  truncated  to  just  5).     In  certain  cases,   features 
are  calculated  by  the  program;  these  calculated  values  are  also  truncated. 


In  discussing  the  data  and  control  cards,   the  term  "number"  will  be  used 
generically  to  denote  "a  numerical  item"  while  the  term  "quantity"  will  de- 
note "a  particular  numerical  value.  "    This  avoids  phrases  like  "a  number 
that  equals  the  number  of  feature  values.  " 
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001    38,3,5,,,,!  6,5,8,10,2 

Example  of  a  "l"  card 

"Two"  Card  Format 


1 


Cards  having  function  codes  equal  to  002  or  b02  or  bb2  (b  equals  blank)  are 
used  to  define  coefficient  vectors.     If  10  coefficient  vectors  have  already  been 
defined,  the  card  is  ignored.     "Two"  cards  may  be  used  to  define  new  features 
as  linear  combinations  of  old  features.     The  second  field  of  the  "two"  card 
contains  the  number  of  the  feature  to  be  created  or  replaced.     Field  three  is 
a  scaling  factor  for  the  new  feature.     Field  four  is  a  constant  term  which  is 
used  in  determining  the  new  feature.     Field  five  contains  the  coefficient  of  the 
old  feature  number  one  in  the  expression  defining  the  new  feature.     Field  six 
contains  the  coefficient  of  the  old  feature  number  two,   field  seven,   the  co- 
efficient for  old  feature  number  three,   and  so  on.     The  new  feature  is  form- 
ed by  multiplying  each  element  in  the  feature  vector  by  its  corresponding  co- 
efficient (fields  five,    six,    seven,   etc.  ,   of  the  "two"  card);  then  adding  all  the 
terms  produced,   plus  the  constant  from  field  four  of  the  "two"  card;  then  mul- 
tiplying the  resulting  value  by  the  scaling  factor  (field  three  of  the  "two"  card) 
and  substituting  the  final  result  for  the  feature  specified  in  field  two  of  the 
"two"  card.     New  elements  of  feature  vectors  may  be  created  in  this  way,   or 
old  elements  may  be  replaced  by  new  values.     The  substitution  does  not  occur 
until  all  new  elements  have  been  calculated.     The  procedure  is  applied  to  each 
feature  vector,   although  some  elements  (or  even  most  elements)  of  the  feature 
vector  remain  unchanged.     A  "five"  card  (defined  later)  must  be  used  before 
any  "two"  cards,  to  indicate  which  features  are  to  be  used  in  the  procedure. 

Fields  four  and  up  may  contain  non-integer  values;  for  example,    .  06737, 
6.  737E-2  and  +6.  737E-02  appearing  in  fields  four  and  up  will  each  be  read  as 
the  non-integer  value  0.  06  737.     Non-integers  in  fields  one,  two  or  three  will 
be  truncated. 
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)02   1,  10000,  -3.18813,  .17126,  .09952,  .06737 '  "\ 

002  ,1000, ,-.275,-.630,1. 324  ~        ^ 

Example  of  a  "2"  card  format 


.-"Three"  Card  Format 

A  card  with  function  code  003  in  its  first  field  is  used  to  assign  weighting 
values  to  the  various  classes  of  feature  vectors.     This  weighting  value  is 
proportional  to  the  a  priori  probability  for  the  corresponding  class.     The 
class  probabilities  are  calculated  by  dividing  each  weight  by  the  sum  of  all 
the  weights.     Normally  the  weight  for  a  class  will  be  equal  to  the  quantity  of 
samples  in  that  class.     The  second  field  is  a  number  indicating  the  quantity 
of  classes  to  be  used,  and  is  also  equal  to  the  quantity  of  weighting  elements 
on  the  "three"  card.     Field  three  contains  weight  for  class  one,   field  four 
contains  the  weight  for  class  two,   field  five  the  weight  for  class  three,    and 
so  on,   with  a  weight  factor  for  each  class. 


003  4,  12,  14,  6,  7  "  ^v 

Example  of  a  "3"  card 


"Four"  Card  Format 


Assignment  of  feature  vector  "types"  to  "classes"  is  done  by  using  a  class 
assignment  card,   having  004  in  its  first  field.     The  second  field  of  a  "four" 
card  indicates  the  quantity  of  feature  vector  types  to  be  assigned  to  classes, 
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and  must  be  20  or  less.     The  third   field  contains  the  class  number  for  vectors 
of  type  1.     The  fourth  field  contains  the  class  number  of  vectors  of  type  2, 
fifth  field  is  class  for  vector  type  3,   etc.     All  class  numbers  must  be  values 
between  zero  and  ten  inclusive;  specified  class  numbers  greater  than  ten  are 
set  equal  to  ten  by  the  program.     Also,   if  a  class  number  is  greater  than  the 
number  of  classes  as  specified  in  field  two  of  the  "three"  card,  the  class 
number  from  field  two  of  the  "three"  card  is  used.     Note  that  several  types 
may  be  assigned  to  the  same  class. 

This  type-to-class  conversion  is  used  to  combine  a  prior  designated  subclass- 
es into  a  single  class  for  the  classifier  design.     In  designing  the  bus  classi- 
fier each  different  vehicle  tested  was  given  a  different  type  number.     This 
helped  to  keep  track  of  the  way  different  kinds  of  vehicles  were  classified, 
but  to  design  the  classifier,  all  the  busses  were  assigned  to  one  class  and  all 
the  non-busses  were  assigned  to  one  class. 


004  4,  1,  2,  3,  3  ' N 

Example  of  a  "4"  card 


"Five"  Card  Format 

A  card  with  its  first  field  equal  to  005  is  used  for  feature  selection.     Field 
two  of  a  "five"  card  contains  a  value  (less  than  or  equal  to  ten)  indicating 
the  quantity  of  features  to  be  selected.     Remaining  fields  contain  values  in- 
dicating the  number  of  the  selected  feature.     For  example,   assume  feature 
vectors  containing  nine  features  are  available.     If  we  wish  to  use  the  first, 
third,   fifth,   seventh,   and  ninth  features  of  these  vectors,  the  "five"  card 
would  look  like  this:  005  5,   1,   3,   5,   7,    9.     The  feature  vector  which  is  then 
available  to  be  used  by  the  program  contains  only  the  five  specified  features 
instead  of  its  original  nine. 
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W5  3,  1,  2,  4  A 

Example  of  a  "5"  card  format  ' 

Two-Card  Input  Format 

Besides  the  "one"  card,   feature  vectors  maybe  specified  to  the  program  in 
another  way  that  uses  two  cards  instead  of  one.     These  cards  have  first 
fields  of  Oil  and  012,    respectively.     The  second  field  of  the  "eleven"  card 
contains  a  vector  identifying  number,   the  third  field  indicates  the  "type"  of 
feature  vector,    and  fields  four,   five,   and  six  contain  identifying  informa- 
tion.    The  "twelve"  card  contains  012  in  its  first  field,   an  identifier  in  the 
second  field,  the  identifier  from  field  two  of  the  corresponding  "eleven" 
card  in  field  three  and  elements  (features)  of  the  feature  vector  in  succeed- 
ing fields.     More  than  one  "twelve"  card  may  correspond  to  a  single  "eleven" 
card,   but  the  "eleven"  card  must  preceed  all  corresponding  "twelve"  cards. 

This  two  card  input  format  is  useful  when  repeated  experiments,  with  the 
same  controlled  conditions,  are  used  to  gain  information  about  the  statistical 
variations  in  the  feature  measurement  process.     In  this  situation  a  single 
"eleven"  card  is  prepared  to  identify  the  test  conditions.     Then  for  each  sepa- 
rate experiment  performed  under  these  conditions,  a  separate  "twelve"  card 
is  prepared  containing  the  features  produced  by  the  experiment.     Using  the 
two  card  format  thus  reduces  the  amount  of  key  punching  that  has  to  be  done 
to  load  the  data  into  the  program. 


011   5,  3,  20,  12 

"2"  -  Card  Input  Format 


012  25,5,17,10,24,31,2500,2000,3000  ~\ 
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CONTROL  CARD  FORMATS  AND  CONTENTS 

The  first  three  character  positions  (first  three  columns)  on  any  input  card 
are  taken  together  as  a  single  data  field,   as  one  item  of  data.     The  content 
of  this  first  field  indicates  the  function  code  for  the  card,   designating  the 
use  to  be  made  of  the  remaining  information  on  the  card.     Card  inputs  are 
used  to  establish  such  things  as  listing  options,   classifier  method,   class 
assignments,   class  probabilities,  feature  vector  values.     Generally,  a 
data  input  card  has  a  positive  value  in  its  first  field,  while  program  con- 
trol cards  contain  negative  values  in  the  first  field.     Except  for  the  card 
used  to  indicate  date  and  identification,    card  fields  after  the  first  are 
defined  as  being  widthless,   which  means  the  fields  are  delimited  by 
symbols  punched  into  the  card  (such  as  commas)  rather  than  by  external 
specifications  (in  the  program  code  itself)  of  allowable  field  size. 

"Minus  One"  Card  Format 

The  exception  to  the  widthless  field  rule,  as  noted  above,   is  for  the  card 
used  to  indicate  the  date  and  identification  of  a  particular  execution  of  the 
program.     This  identifier  card  has  a  structured  format  which  must  be 
used  in  order  to  ensure  proper  recognition  by  the  program.     As  on  all 
cards,    the  first  three  character  positions  contain  the  code  for  the  card 
function;  in  this  case  (identifier  card)  this  code  is  -1.     This  may  be 
punched  into  the  card  several  different  ways,    such  as:    -01  or  b-1  (where 
b  indicates  blank  or  space)  or  -bl.     Note  that  if  -lb  is  punched  into  this 
first  field,    the  program  will    treat  the  blank  as  a  zero  and  will  read  the 
field  as  -10.     An  error  will  occur,   since  -10  is  not  an  allowable  code. 
The  second  field  of  this  card  occupies  four  card  columns,   numbers  4,  5,  6, 
and  7;  and  should  contain  the  date,    in  a  format  such  as  0215  or  1103  (mean- 
ing February  15  or  November  3),   respectively.     The  third  field  starts  in 
column  8  and  contains  any  numbers  or  letters  desired  as  an  identification. 
Only  the  first  eight  characters  of  this  identifier  are  used;  characters 
after  column  15  are  ignored. 


-010615TC2B — TT 

Minus  "1"  Card  Format 
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"Minus  Two"  Card  Format 

A  card  having  a  function  code  of  -2  (punched  in  the  first  three  columns  as: 
-02  or  b-2  or  -b2  where  b  indicates  blank  or  space)  is  used  to  indicate  the 
mode  of  operation  of  the  classifier.     The  second  field  of  this  "minus  two" 
card  starts  in  column  5  and  contains  the  actual  mode  indication  number. 
Values  in  field  two  and  their  meanings  are: 

1:  Method  1  classifier:  determines  the  coefficient  vector  defining 
the  discriminant  for  each  class  pair  using  the  minimum  proba- 
bility of  error  (least  squares)  decision  rule  (explained  in  chapter  3), 

2:      Method  2  classifier:    determines  the  coefficient  vector  defining 

the  discriminant  for  each  class  pair  using  the  direction  of  smallest 
deviation  decision  rule. 

3:      Logical  Mode  Classifier:    determines  class  membership  by  assign- 
ing*a  logical  value  (true  or  false)  to  each  feature  of  a  feature  vec- 
tor dependent  upon  the  feature  being  greater  than  zero  (true)   or 
not  (false).     "True  is  represented  by  the  digit  1  and  "false"  by 
the  digit  zero. 

0:      No  classification  is  to  be  performed. 

In  the  case  of  the  logical  mode  classifier,   another  value  is  required  on 
the  "minus  two"  card:    the  quantity  of  features  in  each  vector  to  be  used 
in  the  logical  mode.     This  value  is  punched  as  the  third  field  on  the  card. 
For  example,    if  the  following  "minus  two"  card  is  sensed  by  the  program 

-02  3, 5 

the  logical  mode  will  be  run,   using  the  first  five  features  of  each  feature 
vector.     For  classifier  methods  1  and  2,    this  third  field  is  not  required 
and  if  punched,    is  ignored  by  the  program. 


^ 


Minus  "2"  Card  Format 
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"Minus  Three"  Card  Format 

A  function  code  of  -3  us  used  to  control  the  output  listing  of  the  program. 
Values  for  the  second  field  of  a  "minus  three"  card  and  meanings  are: 

5  List  class  dispersions 

6  List  class  mean  values  and  class  covariances 

7  List  total  data  set  covariance,    list  within  class  covariances 
and  between-class  covariances. 

These  values  may  occur  in  any  order  and  should  be  separated  by  commas  if 
more  than  one  of  them  is  punched.     An  example  of  a  proper  "minus  three" 
card: 

-03  5,    6,    7 

specifies  all  options  are  to  be  performed.     A  negative  value  in  the  data 
field  causes  suppression  of  the  corresponding  option. 


03  5,6,7 

Minus  "3"  Card  Format 

"Minus  Four"  Card  Format 

A  "minus  four"  card,   with  value  -04  in  its  first  field,    is  used  to  restore  the 
set  of  feature  vectors  used  in  the  previous  execution.     These  vectors  were 
saved  when  the  previous  execution  was  started;  that  is,   when  the  previous 
"minus  ninety-nine"  card  was  encountered.     A  value  equal  to  the  quantity  of 
vectors  being  saved  was  also  stored  at  that  time;  when  the  vectors  are  re- 
stored, this  value  is  used  to  control  the  quantity  of  vectors  restored.     Every 
time  vectors  are  saved  (at  the  beginning  of  an  execution)  values  in  the  "save" 
area  from  a  previous  "save"  are  overwritten  by  the  new  values.     If  fewer  vec 
tors  are  saved  in  one  instance  than  were  saved  the  previous  instance,   errors 
could  result  during  restoration  if  the  count  of  saved  vectors  were  not  used. 
The  restored  data  is  placed  in  the  feature  vector  array  starting  with  the  next 
available  location  in  that  array. 
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\ 

Minus  "4"  Card  Format 


"Minus  Five"  Card  Format 

A  "minus  five"  card  is  used  to  reset  (to  zero)  the  counter  which  indicates  the 
next  available  location  to  write  into  the  feature  vector  array.     This  counter 
is  called  NFV  (number  of  feature  vectors),   and  is  incremented  by  one  each 
time  a  feature  vector  is  written  into  the  feature  vector  array.     The  counter 
NFV  starts  equal  to  zero  at  the  beginning  of  a  run  of  several  executions  ("mi- 
nus ninety-nine"  cards)  but  is  not  reset  (to  zero)  by  the  program  encountering 
a  "minus  ninety-nine"  card.     A  second  counter,  called  Flag  1,   is  increment- 
ed by  one  each  time  a  feature  vector  is  read  by  the  program  from  a  data  in- 
put card,   and  is  reset  to  zero  by  a  "minus  ninety-nine"  card.     Thus  Flag  1 
has  a  value  equal  to  the  number  of  feature  vector  cards  read  by  the  program 
since  the  last  execution.     The  NFV  counter  will  be  reset  to  zero  (without  us- 
ing a  "minus  five'1  card)   if  no  feature  vector  cards  have  been  read  (Flag  1  = 
0)  when  a  "minus  four"  (restore  saved  data)  card  is  encountered.     Thus  re- 
stored data  will  always  be  written  into  the  feature  vector  array  starting  at 
the  beginning,   unless  one  or  more  feature -vector  cards  have  already  been 
read  by  the  program  (Flag  1=0)  for  the  current  execution.  A  "minus  five" 
card  has  the  function  code  -5  punched  in  its  first  field  and  can  be  used  before 
loading  new  data  to  be  used  for  calculations. 


-05 

Minus  "5"  Card  Format 
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"Minus  Six"  Card  Format 

A  function  code  of  -6  or  -06  is  used  to  indicate  whether  or  not  a  secondary 
transformation  is  to  be  performed  on  the  feature  data.     The  second  field  of 
a  "minus  six"  card  should  contain  a  value  of  zero  to  indicate  that  no  secondary 
transformation  is  desired,   and  should  contain  a  value  of  one  or  two  to  indi- 
cate that  a  secondary  feature  transformation  is  to  be  performed  on  the  input 
data  feature  vectors. 

This  transformation  is  determined  by  the  value  in  the  second  field  of  the  "mi- 
nus six"  card.     The  transformation  is: 

new  feature  one  =  1000*old  feature  three/FACT 

new  feature  two  =  1000*old  feature  four /FACT 

new  feature  three  =  1000*old  feature  six /old  feature  five 

new  feature  four  =  1000*old  feature  seven/old  feature  five 

new  feature  five  =  old  feature  three  +  old  feature  four 

new  feature  six  =  1000*old  feature  one /FACT 

new  feature  seven  =  1000*old  feature  three/FACT  +  1000*old  feature  four/ 

FACT 

where  FACT  =  old  feature  one  +  old  feature  two  if  the  value  in  the  second 
field  of  the  "minus  six"  card  is  one  and  FACT  =  old  feature  two  if  the  value  in 
the  second  field  is  two.     The  transformation  is  performed  on  all  feature  vec- 
tors except  for  feature  vectors  read  using  "one"  cards,  with  the  seventh  field 
empty  and  feature  vectors  read  using  an  "eleven"  card  with  no  corresponding 
"twelve"  cards  in  the  deck.     Such  feature  vectors  are  suppressed  by  the  trans- 
formation.    During  execution  (followkig  a  "minus  ninety-nine"  card)  this  trans- 
formation is  performed  before  any  other  operations.     Omission  of  the  "minus 
six"  card  from  a  deck  is  identical  to  the  use  of  a  "minus  six"  card  with  second 
field  equal  to  zero.     This  transformation  is  used  to  convert  the  "raw"  bus  de- 
tector measurements  into  the  normalized  features  used  by  the  classifier. 
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-06  1  '  "\ 

Minus  "6"  Card  Format 

"Minus  Seven"  Card  Format 

A  function  code  (first  card  field)  of  -7  designates  a  card  which  controls  trade- 
off listing  options  for  a  given  feature,  the  given  feature  being  identified  by  the 
number  in  the  second  field  of  the  "minus  seven"  card.     The  tradeoff  listing 
produced  by  a  "minus  seven"  card  is  a  list  of  all  feature  vectors  in  increasing 
order  based  on  the  feature  designated.     For  example,   a  "minus  seven"  card 
with  its  second  field  equal  to  2  will  cause  the  feature  vectors  to  be  listed  with 
the  vector  having  the  smallest  feature  2  value  first  and  the  vector  with  the 
largest  feature  2  value  last,   and  the  other  feature  vectors  ordered  between 
these  two.     If  the  second  field  of  a  "minus  seven"  card  contains  a  negative 
value,   the  selected  feature  is  the  negative  of  this  value,   and  the  listing  gives 
the  feature  values. 


-07  1 


07  -3 

Minus  "7"  Card  Format 


"Minus  Eight"  Card  Format 

A  "minus  eight"  card  may  be  used  to  project  the  feature  vector  set  into  a  sub- 
space  of  the  space  the  vectors  are  in  originally.     Subspaces  have  fewer  dimen- 
sions than  the  space  containing  them;  for  example,   a  plane  (two  dimensions) 
is  a  subspace  of  three-dimensional  space;  a  line  (one  dimension)  is  a  subspace 
of  three-dimensional  space;  a  line  (one  dimension)  is  a  subspace  of  a  plane, 
and  is  also  a  subspace  of  a  three-dimensional  space.     Subspace  projections 
are  useful  in  observing  data  distributions;  the  data  are  constrained  to  lie  in 
the  subspace,   thus  removing  a  number  of  degrees  of  freedom  equal  to  the 
difference  in  number  of  dimensions  between  the  subspace  and  the  total  space. 
Hy  also  projecting  the  data  into  a  complementary  subspace,    variations  which 


106 


were  lost  in  the  subspace  projection  are  shown.     This  allows  a  test  to  be  made 
upon  data  which  appear  empirically  to  lie  in  a  subspace  of  the  total  space,  to 
determine  if  there  is  variation  not  contained  in  the  supspace.     For  example, 
in  three-dimensional  space,   an  empirical  data  distribution  may  appear  to  lie 
in  a  single  plane  in  the  three  space.     Such  a  planar  distribution  would  simplify 
the  classifier,  but,   if  the  data  in  fact  is  not  completely  in  the  plane,   variations 
which  might  be  useful  in  the  solution  will  be  lost  if  the  planar  distribution  is 
used  alone.     By  using  subspace  projection  into  the  supposed  plane  of  the  dis- 
tribution,  classification  may  be  attempted  with  the  planar  distribution.     By 
projecting  to  the  complement  of  the  planar  subspace  (in  this  case  the  comple- 
ment of  the  planar  subspace  is  a  normal  line  to  the  plane)  variations  not  in 
the  plane  may  be  observed,   and  may  in  fact  provide  an  even  better  classifi- 
cation solution.     This  projection  technique  may  be  extended  to  as  many  di- 
mensions as  required;  the  general  approach  is  to  try  a  subspace  solution  and 
then  see  if  the  complement  projection  offers  additional  information.     Of  course, 
if  the  complement  projection  shows  very  little  additional  variation,  the  pro- 
blem's solution  can  be  simplified  by  projecting  onto  the  subspace,  thus  re- 
ducing the  degrees  of  freedom  of  the  original  distribution  without  loss  of  in- 
formation. 

The  program  uses  a  "minus  eight"  card  to  control  projections;  the  second 
field  of  a  "minus  eight"  card  contains  a  value  indicating  that  no  projection  is 
desired  (second  field  =  0),   or  projection  to  a  defined  subspace  (second  field 
=  1)  or  projection  to  the  orthogonal  complement  of  a  defined  subspace  (second 
field  =  2).     Omission  of  the  "minus  eight"  card  from  a  deck  is  identical  to  use 
of  a  "minus  eight"  with  second  field  equal  to  zero. 

Subspaces  are  defined  by  using  coefficient  cards  ("two"  cards)  to  define  vec- 
tors which  span  the  subspace.     The  fields  of  a  "two"  card  used  for  projection 
are  identical  to  those  of  a  "two"  card  used  to  define  a  new  feature  (see  "two" 
card  discussion)  except  fields  two  and  four  (new  feature  number  and  added 
constant  term)  are  ignored  by  the  program  when  the  card  is  used  to  define  a 
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subspace  spanning  vector.     Since  all  vectors  pass  through  the  origin,   any  two 
vectors  will  define  (span)  a  two-dimensional  plane;  likewise  any  N  vectors 
will  define  an  N-dimensional  subspace.     By  selecting  subspaces  within  a 
multi-dimensional  data  space,   projections  may  be  performed  to  any  subspace 
(or  its  orthogonal  complement)  within  the  data  space,   and  printouts  obtained 
showing  the  subspace  data  distribution. 


-08  1  """"X 

Minus  "8"  Card  Format 


"Minus  Ninety- nine"  Card  Format 

Function  code  -99  punched  into  the  first  field  (first  three  columns)  of  a  card 
signals  that  all  data  has  been  input  to  allow  execution,  and  that  execution 
should  begin.     No  other  fields  are  recognized  or  needed  on  a  "minus  ninety- 
nine"  card. 
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Minus  "99"  Card  Format 


TEST  CASE  1 

To  better  understand  the  steps  performed  by  the  CTC  program,   a  test  case 
was  developed.     This  test  case  involved  39  samples  (feature  vectors),   each 
having  two  features.     This  data  set  is  easily  visualized,   and  can  be  plotted 
on  graph  paper.     Each  of  the  39  feature  vectors  was  specified  to  the  program 
by  using:  1)  an  identifying  number,    1-39;  2)  an  x  value  (feature  1);  3)  a  y  value 
(feature  2);  and  4)  a  type  identifier.     The  type  identifiers  were  arbitrarily 
chosen  as  4,    5,   6  and  each  was  assigned  to  a  class:  type  4  assigned  to  class 
1,   type  5  to  class  2,   type  6  to  class  3. 
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TABLE  17.     CONTROL  AND  DATA  CARD  FUNCTIONS 


1 

Code 

Description 

or  Use 

Remains  in  Effect 

Until  Explicitly 

Changed* 

r 

Action  Immediate 

(Before  Next  Card 

is  Processed) 

-99 

Execute 

- 

Yes 

-8 

Project  (NPCON) 

Yes 

No 

-7 

Feature  tradeoff 

No 

No 

-6 

Secondary  feature 
(MODE  2) 

No 

No 

-5 

NFV  =  0 

No 

Yes 

-4 

Restore  feature  data 

No 

Yes 

-3 

Listing  options 

Yes 

No 

-2 

Method  (KM ODE) 

Yes 

No 

-1 

Identifier 

Yes 

Yes 

1 

Feature  data 

- 

- 

2 

Coefficient  data 

- 

- 

3 

Class  card 

Yes 

Yes 

4 

Type  card 

Yes 

Yes 

5 

Feature  selection  card 

Yes 

Yes 

11 

1st  Feature  card 
bus  detector 

- 

Yes 

12 

- 

2nd  Feature  card 
bus  detector 

i , — _ — _ — 

Yes 

That  is  to  say,  the  option  or  control  function  or  parameter  is  not  changed 
or  turned  off  by  the  program  during,  before  or  after  execution. 
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TABLE  18.     CONTROL  CARD  AND  DATA  CARD  FORMAT  SUMMARY 


1  irst 

tioH 

Second 
Field 

Third 
Field 

Fourth 
Field 

Fifth 
Field 

Sixth 
Field 

Seventh 
Field 

Eighth 

Field 

Ninth 
Field 

Tenth 
Field 

Eleventh 
Field 

Twelfth 
Field 

Thirteenth 
Field 

1 

i0l 

Type 

Quantity  of 
Features 

ro2 

Blank 
field 

Blank 
field 

Feature 
1 

Feature 
2 

Feature 
3 

Feature 
4 

Feature 
5 

Feature 
6 

2 

Feature 
number 

Scale 
factor 

Constant 
to  be  added 

Coefficient 
1 

Coefficient 
2 

Coefficient 
3 

Coefficient 
4 

Coefficient 
5 

Coefficient 

6 

Coefficient 

7 

Coefficient 
8 

Coefficient 
S 

3 

Quantity  of 
classes 

Quantity  of 
vectors  in 
class  1 

Quantity  of 
vectors  in 
class  2 

Quantity  of 
vectors  in 
class  3 

Quantity  of 
vectors  in 
class  4 

Quantity  of 
vectors  in 
class  5 

Quantity  of 
vectors  in 
class  6 

Quantity  of 
vectors  in 
class  7 

Quantity  of 
vectors  in 
class  8 

Quantity  of 
vectors  in 
class  9 

Quantity  of 
vectors  in 
class  10 

Blank  to 
end  of 
card 

4 

Quantity  of 
types 

Class  NR 
for  type  1 

Class  NR 
for  type  2 

Class  NR 
for  type  3 

Class  NR 
for  type  4 

Class  NR 
for  type  5 

Class  NR 
for  type  6 

Class  NR 
for  type  7 

C  lass  NR 
for  type  8 

Class  NR 
for  type  9 

Class  NR 
for  type  10 

Class  NR 
for  type  11 

1 

Quantity  of 
features  to 
he  used 

NR  of  1st 
used  feature 

NR  of  2nd 
used  feature 

NR  of  3rd 
used  feature 

NR  of  4th 
used  feature 

NR  of  5th 
used  feature 

NR  of  6th 
used  feature 

NR  of  7th 
used  feature 

NR  of  8th 
used  feature 

NR  of  9th 
used  feature 

NR  of  10th 
used  feature 

Blank  to 
end  of 
card 

-1 

Date 

Identification 

Code 

-3 

-4 

Classifier 
method 

List  Option ' 

Logical 
feature 
count 

Option 

Option 

-5 

(Sets  NFV  =  0> 

Primary  or 

secondary 

features? 

-7 

Feature  NR 
for  tradeoff 

listing 

-8 

Subspace  or 
complement 

11 

roi 

Type 

CHAR  11 

CHAR  2 

CHAR  3 

12 

ID2 

mi 

Feature  1 

Feature  2 

Feature  3 

Feature  4 

Feature  5 

Feature  6 

Feature  7 

Feature  8 

Feature  9 

Feature  10 

"Two"  card:  A  "five"  card  must  occur  before  any  "two"  cards  in  the  deck. 

"Two"  card  defines  a  new  value  for  the  feature  number  designated  in  field  two  or  spanning  get  vectors 
This  new  value  is  given  by: 

new  feature  =  scale  factor  [constant  +  (coeff  l)-feature  1  + 

{.coeff  2)-feature  2  +  (coeff  3)-feature  3  1 

+  (coeff  4) -feature  4  +  .    .    .   +  (coeff  10)  ■  feature  10J 

"Minus  three"  card:  negative  values  suppress  options . 

"Minus  four"  card  restores  old  data,  which  was  saved  during  previous  execution. 

"Minus  six"  card;  second  field  =  0,   primary;  =  1  or  =  2,    secondary. 

"Minus  eight"  card;  second  field  =  1,   project  to  EUbspace 

second  field  =  2,    project  to  complement  of  subspace. 

"One"  card  may  contain  up  to  ten  features 

"Two"  card  may  contain  up  to  ten  coefficients 

"Four"  card  may  contain  up  to  twenty  types;  but  only  a  maximum  of  ten  classes  in  allowed. 

"Minus  nine"  card  may  contain  up  to  twenty  types.   Maximum  number  of  features  in  a  vector  is  ten. 

Fifth  field  of  "one"  card  may  be  empty. 
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Data  was  input  using  39  "one"  cards,   defined  elsewhere.     Class  assignment 
was  done  by  using  a  single  "four"  card,   also  defined  elsewhere.     Other  cards 
required : 

1.  A  "minus  two"  card,  with  mode  =  1 

2.  A  "minus  three"  card,    specifying  all  options 

3.  A  "minus  six"  card,    specifying  primary  features 

4.  A  "minus  eight"  card,    specifying  no  projections 

5.  Pour  "minus  seven"  cards,  one  each  for  listings  ordered  by  a)  feature  1, 
b)  feature  2;  and  one  each  for  tradeoff  listings  for  a)  feature  1,  b)  feature 
2. 

-7  -1  listing  ordered  by  feature  1 

-7  -2  listing  ordered  by  feature  2 

-7  1  tradeoff  listing  for  feature  1 

-7  2  tradeoff  listing  for  feature  2_ 

6.  A  single  "three"  card,    indicating  the  number  of  feature  vectors  of  each 
type  and  the  number  of  types. 

7.  A  single  "five"  card,    to  indicate  use  of  two  features,   namely  feature  1 
and  feature  2,   for  calculations. 

8.  A  single  "minus  one"  card,   with  program  date  and  ID. 

9.  A  single  "minus  ninety-nine"  card,   following  all  other  cards,    to  begin 
execution.     Figure  12  shows  this  deck. 
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Figure  12.     Example  Decks 


Table  19  shows  the  parameter  and  data  listings  produced  by  the  program. 
Output  produced  by  the  program,   for  the  above  inputs  and  controls,    included 
the  statistical  analysis  of  the  data,   giving  mean  values  within  a  class  and 
the  mean  value  for  all  data  taken  together,   dispersions  of  data  classes, 
covariances  between  and  within  classes,   distances  and  angles  (in  two-dimen- 
sional space)  between  class  means  (see  Table  24). 

Tables  20  through  23  show  the  four  tradeoff  listings  for  the    39  feature 
vectors.     Table  22  (tradeoff  for  feature  number  1)  orders  the  data  by  the 
values  of  feature  number  1.     In  this  listing,    the  first  column  is  the  sequen- 
tial numbering  of  the  feature  vectors  after  the  ordering.     Column  two  (NO) 
is  the  sequential  numbering  of  the  feature  vectors  before  the  ordering. 
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TABLE  19.     PARAMETER  AND  DATA  LISTINGS 
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p 

21 

22 

22 

p 

P 

?p 

23 

?3 

K 

p 

P-; 

?'. 

?fa 

7 

p 

21 

25 

PR 

7 

p 

2c 

26 

26 

c 

P 

26 

27 

=  7 

fa 

p 

27 

28 

J  -t 

R 

p 

2~ 

29 

79 

7 

P 

29 

3: 

30 

6 

P 

3r 

31 

31 

r 

P 

3; 

3  c 

32 

c 

P 

3? 

33 

33 

7 

? 

33 

3* 

3* 

6 

? 

3fa 

35 

35 

K 

? 

35 

36 

36 

7 

? 

36 

37 

37 

6 

? 

37 

38 

38 

t 

? 

38 

39 

39 

6 

2 

39 

^ELECTED   SABLES 

C-L.ASS  .-123 

\iJMBt"  o      12      1»      13 

"^SS   •    39 


8 
i 
9 
10 
10 
If 
l-> 
11 
11 
1! 
11 
11 
12 
1' 
12 
1' 
13 
13 
13 

13 
1* 
lfa 
1» 
15 
16 
16 


13 
1' 


9 
11 
15 


11 
13 


lj 
lfa 
15 
7 
8 
11 
lfa 


13 
5 
9 

16 
t 
5 
6 
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TABLE  20.     TRADEOFF  LISTING  FOR  FEATURE  NUMBER  -1 


lMTE 

610 

10 

TC1AM! 

TRADEOFF" 

F8R 

FEATURE  NuM6ER 

-1 

NB 

CL 

SCPRE 

1 

? 

3 

4 

5 

1 

1 

1 

3, 

0000 

3 

4 

0 

r> 

0 

2 

6 

1 

4, 

•  oooo 

4 

3 

n 

0 

0 

3 

5 

1 

4 

0000 

4 

5  ■ 

0 

0 

J 

4 

8 

1 

5, 

0000 

5 

13 

£ 

p 

0 

5 

7 

2 

5, 

0000 

5 

7 

0 

p 

0 

6 

4 

1 

5 

'0000 

5 

5 

3 

3 

0 

7 

3 

1 

5, 

-0000 

K 

4 

0 

/^ 

J 

8 

2 

1 

5, 

0000 

5 

3 

o 

0 

0 

9 

9 

2 

6, 

0000 

6 

lc 

0 

n 

r\ 

10 

10 

1 

7 

'0000 

7 

7 

0 

"i 

0 

11 

15 

3 

8 

'000C 

8 

15 

o 

0 

12 

14 

2 

8 

•  0000 

g 

11 

Q 

0 

0 

13 

13 

2 

8 

•0000 

8 

9 

1 

o 

0 

14 

12 

2 

8 

•0000 

8 

5 

0 

p 

15 

11 

1 

8 

•  cooo 

? 

5 

p 

r* 

0 

16 

16 

1 

9 

'0000 

9 

<* 

0 

r> 

c 

17 

20 

3 

10 

•0000 

10 

13 

o 

?' 

0 

18 

19 

2 

10 

-0000 

ir. 

11 

n 

0 

o 

19 

18 

2 

10 

'0000 

lc 

8 

Q 

3 

0 

20 

17 

1 

10 

•  cooc 

10 

6 

V 

r. 

0 

21 

25 

3 

11 

•  0000 

11 

15 

o 

■*"l 

0 

22 

24 

3 

11 

•ooo.; 

11 

14 

pi 

0 

23 

23 

2 

11 

•  oooo 

11 

lc 

0 

p 

0 

24 

22 

2 

11 

•  oooo 

11 

9 

3 

r- 

0 

25 

21 

3 

11 

•0000 

11 

c; 

V 

o 

0 

26 

29 

3 

12 

•  oooo 

1? 

14 

p 

0 

J 

27 

28 

2 

12 

•  oooo 

12 

11 

p 

0 

0 

28 

27 

1 

12 

•  oooo 

12 

8 

0 

p 

0 

29 

26 

2 

12 

•  oooo 

1? 

7 

C 

3 

0 

30 

33 

3 

13 

•  ocoo 

13 

13 

p 

3 

v"l 

31 

32 

2 

13 

•  O0Q0 

13 

1.0 

0 

3 

0 

32 

31 

2 

13 

'OCOw 

13 

8 

o 

n 

0 

33 

30 

3 

13 

•  oooo 

13 

4 

0 

r\ 

0 

34 

36 

3 

14 

•  oooo 

14 

16 

n 

0 

35 

35 

2 

14 

•  oooo 

14 

9 

o 

0 

0 

36 

34 

3 

14 

•  oooo 

14 

5 

0 

p 

0 

37 

37 

3 

15 

•  oooo 

15 

6 

Q 

0 

u 

38 

39 

3 

16 

•  oooc 

16 

6 

0 

0 

0 

39 

38 

3 

16 

•  oooo 

16 

5 

f~ 

n 

0 

8 

9 

10 

p 

0 

J 

o 

0 

0 

0 

0 

0 

3 

0 

0 

Q 

0 

0 

'J 

0 

0 

3 

c 

0 

0 

0 

0 

n 

0 

0 

'j 

0 

0 

o 

0 

0 

Q 

0 

r\ 

3 

0 

0 

o 

0 

0 

3 

IP 

0 

r» 

0 

0 

U 

0 

n 

,3 

0 

3 

3 

0 

p 

3 

c 

0 

3 

o 

0 

3 

0 

0 

3 

0 

>"» 

0 

0 

3, 

0 

"\ 

'J 

0 

0 

p 

3 

o 

0 

■) 

3 

n 

3 

J 

0 

n 

1 

0 

7 

3 

0 

"» 

-* 

n 

0 

? 

p 

0 

0 

•;, 

p 

A 

,, 

r* 

/■s 

»_: 

0 

0 

3 

_< 

0 

J 

3 

0 

-"\ 

114 


TABLE  21.     TRADEOFF  LISTING  FOR  FEATURE  NUMBER  -2 


OATE 

610 

ID 

TC1A"1 

TRADE6FF 

F9R 

FEATURE  NUMBER 

-? 

N9 

CL 

SC8RL 

1 

2 

3 

1 

2 

1 

3. 

ocoo 

5 

3 

0 

2 

30 

3 

4, 

0000 

13 

4 

D 

3 

16 

1 

4, 

OCOO 

9 

4 

0 

4 

3 

1 

4, 

000C 

c 

4 

0 

5 

1 

1 

4, 

coo: 

3 

4 

6 

38 

3 

5, 

0000 

16 

5 

n 

7 

34 

3 

5, 

cooo 

14 

5 

'■ 

8 

21 

3 

5, 

ocoo 

11 

5 

" 

9 

11 

1 

5. 

0000 

a 

c 

" 

10 

5 

1 

5, 

0000 

4 

K 

Q 

11 

4 

1 

5. 

nooo 

5 

5 

n 

12 

39 

3 

6. 

0000 

16 

b 

'". 

13 

37 

3 

6, 

OOOn 

15 

6 

o 

1* 

17 

1 

6, 

0000 

10 

6 

2 

15 

26 

2 

7, 

ocoo 

12 

7 

0 

16 

10 

1 

7, 

0000 

7 

7 

■J 

17 

7 

2 

7, 

0000 

=; 

7 

o 

18 

31 

2 

3, 

0000 

13 

£ 

c 

19 

27 

1 

8, 

'0000 

12 

» 

0 

20 

18 

2 

8 

'0000 

10 

? 

-\ 

21 

12 

2 

8 

'000^ 

8 

8 

r* 

22 

35 

p 

y 

•0000 

14 

P 

3 

23 

?? 

2 

9 

•  ocoo 

11 

9 

0 

2* 

13 

2 

9 

'0000 

H 

9 

Q 

25 

6 

1 

9 

>C00f~ 

4 

9 

0 

26 

32 

2 

10 

'0000 

13 

lo 

Q 

27 

23 

2 

10 

'0000 

11 

l- 

n 

28 

9 

2 

10 

'OCOO 

6 

lc 

0 

29 

28 

2 

11 

>000C 

12 

11 

0 

30 

19 

2 

11 

'C00O 

10 

11 

r 

31 

14 

2 

11 

'0000 

8 

11 

0 

32 

33 

3 

13 

.0000 

13 

13 

0 

33 

20 

3 

13 

-oooc 

10 

13 

Q 

3* 

8 

1 

13 

'0000 

5 

13 

0 

35 

29 

3 

14 

'0000 

12 

14 

) 

36 

24 

3 

14 

'OOOC 

11 

14 

0 

37 

25 

3 

15 

>ocoo 

11 

15 

0 

38 

15 

3 

15 

•oooo 

8 

15 

o 

39 

36 

3 

16 

•0000 

14 

16 

0 

to 


3 

0 

", 

Q 

0 

— 

? 

0 

-\ 

- 

0 

**l 

1 

0 

-J 

-j 

0 

"\ 

0 

0 

n 

3 

0 

3 

C 

*  0 

J 

o 

0 

0 

r> 

0 

T 

> 

0 

0 

0 

3 

*~» 

0 

3 

-) 

0 

■"> 

c 

0 

2 

-) 

0 

0 

0 

0 

- 

0 

0 

n 

0 

0 

-. 

0 

3 

n 

0 

■) 

Q 

0 

0 

3 

0 

3 

0 

0 

0 

,-j 

0 

3 

0 

0 

~ 

0 

0 

c 

0 

0 

0 

0 

0 

0 

0 

0 

n 

0 

0 

o 

0 

0 

3 
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TABLE  22.     TRADEOFF  FOR  FEATURE  NUMBER  1 


^ATE      610    ID    TC1AM1 
TRADEOFF    F9R    r£ATURE    NUMBER 


N9 

ID  ' 

rv' 

CL 

SC9RE     0 

1 

2 

3 

1 

1 

1 

4 

1 

0 

0 

1 

3*0000 

1 

2 

6 

6 

4 

6 

0 

0 

1 

4#0000 

2 

3 

5 

5 

4 

5 

0 

0 

1 

4.0000 

3 

4 

8 

8 

4 

8 

0 

0 

1 

5*0300 

4 

5 

7 

7 

5 

7 

0 

0 

2 

5*0000 

1 

6 

4 

4 

4 

4 

0 

0 

1 

5*0000 

5 

7 

3 

3 

4 

3 

0 

0 

1 

5*0000 

6 

8 

2 

2 

4 

2 

0 

0 

1 

5.0000 

7 

9 

9 

9 

5 

9 

0 

0 

2 

6*0000 

2 

10 

10 

10 

4 

10 

0 

0 

1 

7.0000 

8 

11 

15 

15 

7 

15 

0 

0 

3 

8.0000 

1 

12 

14 

14 

5 

14 

0 

0 

2 

8*0000 

3 

13 

13 

13 

5 

13 

0 

0 

2 

8*0000 

4 

14 

12 

12 

5 

12 

0 

0 

2 

8*0000 

5 

15 

11 

11 

4 

11 

0 

0 

1 

8*0000 

9 

16 

16 

16 

4 

16 

0 

0 

1 

9*0000 

10 

17 

20 

20 

7 

20 

0 

0 

3 

10*0000 

2 

18 

19 

19 

5 

19 

0 

0 

2 

10«0000 

6 

19 

18 

18 

5 

18 

0 

0 

2 

10*0000 

7 

20 

17 

17 

4 

17 

0 

0 

1 

10*0000 

11 

21 

25 

25 

7 

25 

0 

0 

3 

11*0000 

3 

22 

24 

24 

7 

24 

0 

0 

3 

11*0000 

4 

23 

23 

23 

5 

23 

0 

0 

2 

11*0000 

8 

24 

22 

22 

5 

22 

0 

0 

2 

11*0000 

9 

25 

21 

21 

6 

21 

0 

0 

3 

11*0000 

5 

26 

29 

29 

7 

29 

0 

0 

3 

12*0000 

6 

27 

28 

28 

5 

28 

0 

0 

2 

12*0000 

10 

28 

27 

27 

4 

27 

0 

0 

1 

12*0000 

12 

29 

26 

26 

5 

26 

0 

0 

2 

12*0000 

11 

30 

33 

33 

7 

33 

0 

0 

3 

13*0000 

7 

31 

32 

32 

5 

32 

0 

0 

2 

13*0000 

12 

32 

31 

31 

5 

31 

0 

0 

2 

13*0000 

13 

33 

30 

30 

6 

30 

0 

0 

3 

13*0000 

8 

3^ 

36 

36 

7 

36 

0 

0 

3 

14*0000 

9 

35 

35 

35 

5 

35 

c 

0 

2 

14*0000 

14 

36 

34 

34 

6 

34 

0 

0 

3 

14*0000 

10 

37 

37 

37 

6 

37 

0 

0 

3 

15*0000 

ll 

38 

39 

39 

6 

39 

0 

c 

3 

16*0000 

12 

39 

38 

38 

6 

38 

0 

0 

3 

16*0000 

i.3 
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TABLE  23.     TRADEOFF  FOR  FEATURE  NUMBER  2 


DATE 

610  ID 

TC1AM1 

TRADEBFF  nr 

FEATURE 

NU^BE1 

2 

N6 

ID 

TY 

ci 

SC9RE 

0   1 

2 

3 

1 

2 

2 

4 

2 

0 

0 

1 

3 

'0000 

1 

2 

30 

30 

6 

30 

0 

0 

3 

4 

•0000 

1 

3 

16 

16 

4 

16 

0 

0 

1 

4< 

•0000 

2 

4 

3 

3 

4 

3 

0 

0 

1 

4< 

•  oooo 

3 

5 

1 

1 

4 

1 

0 

0 

1 

ki 

•0000 

4 

6 

38 

38 

6 

38 

c 

0 

3 

5< 

•  oooo 

2 

7 

34 

34 

6 

34 

0 

0 

3 

5« 

•  oooo 

3 

8 

21 

21 

6 

21 

0 

0 

3 

5< 

'0000 

4 

9 

11 

11 

4 

11 

Q 

0 

1 

5< 

'0000 

5 

10 

5 

5 

4 

5 

c 

0 

1 

5- 

•  oooo 

6 

11 

4 

4 

4 

4 

0 

0 

1 

5. 

'0000 

7 

12 

39 

39 

6 

39 

0 

3 

6< 

•  oooo 

5 

13 

37 

37 

6 

37 

c 

0 

3 

6< 

•  oooo 

6 

14 

17 

17 

4 

17 

0 

0 

1 

6< 

'0000 

8 

15 

26 

26 

5 

26 

c 

0 

2 

7. 

'0000 

1 

16 

10 

10 

4 

10 

0 

0 

1 

7< 

•  oooo 

9 

17 

7 

7 

5 

7 

0 

0 

2 

7< 

'0000 

2 

18 

31 

31 

5 

31 

0 

0 

2 

8< 

•  oooo 

3 

19 

27 

27 

4 

27 

0 

0 

1 

8< 

'0000 

10 

20 

18 

18 

5 

18 

0 

0 

2 

8. 

•  oooo 

4 

21 

12 

12 

5 

12 

0 

0 

2 

8< 

•  oooo 

5 

22 

35 

35 

5 

35 

0 

0 

2 

9« 

'0000 

6 

23 

22 

22 

5 

22 

0 

0 

2 

9. 

•  oooo 

7 

24 

13 

13 

5 

13 

0 

0 

2 

9. 

'0000 

8 

25 

6 

6 

4 

6 

0 

0 

1 

9. 

•  oooo 

11 

26 

32 

32 

5 

32 

0 

0 

2 

10« 

•  oooo 

9 

27 

23 

23 

5 

23 

0 

0 

2 

10< 

►  oooo 

lo 

28 

9 

9 

5 

S 

c 

0 

2 

10' 

'0000 

11 

29 

28 

28 

5 

28 

0 

0 

2 

111 

•  oooo 

12 

30 

19 

19 

5 

19 

0 

0 

2 

11  « 

•oooo 

13 

31 

14 

14 

5 

14 

0 

0 

2 

111 

•  oooo 

14 

32 

33 

33 

7 

33 

0 

0 

3 

13. 

•  oooo 

7 

33 

20 

20 

7 

20 

0 

0 

3 

13- 

•  oooo 

8 

34 

8 

8 

4 

8 

c 

0 

1 

13. 

oooo 

12 

35 

29 

29 

7 

29 

0 

0 

3 

l'4. 

'0000 

9 

36 

24 

24 

7 

24 

0 

0 

3 

1  4. 

•  oooo 

10 

37 

25 

25 

7 

2b 

0 

0 

3 

15- 

•  oooo 

11 

38 

15 

15 

7 

15 

0 

0 

3 

15. 

•  oooo 

12 

39 

36 

36 

7 

36 

0 

0 

3 

16- 

•oooo 

1-3 
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TABLE  24.     STATISTICAL  ANALYSIS  OUTPUT 


JATE   610  ID  TC1AM1 
STAT 


?EAN  VECT9RS 

CLASS 

1 

6.417 

10*07 

12.62 

6«083 

9*143 

tO.  08 

yiSPERSIBNS 

CLASS 

1 

48.  ?5 

39»50 

39.50 

44.25 

CLASS 

? 

108*4 

92*43 

92*43 

85«43 

CLASS 

3 

164.5 

121*0 

121.0 

123*0 

OVERALL 

MEAN 

1 

2 

9.795 

8.513 

CByARlANCES 

CLASS 

1 

7.Q76 

•  4653 

«4653 

7.243 

CLASS- 

? 

6*923 

•  3469 

•3469 

1.837 

CLASS 

3 

5*314 

-6*124 

-6.1^4 

21»46 

CLASS 

1 

STANDARD 

DEVIATI9NS 

?«660 

2*691     ( 

C6RRELATJ8NS 

1*000 

•6499E-01 

•6499E-01 

1  *000 

CLASS 

2 

STANDARD 

DEVIATIBNS 

2.631 

1*355 

CBRRELATIBNS 

1  *000 

.9729E-'l 

•97?9E-0l 

1  »000 

CLASS 

"5 

STANDARD 

DEVIATIBNS 

2»3o5 

4.632 

CBRRfeLATIBNS 

1*000 

-.5736 

-•5736 

1*000 
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TABLE  24.     STATISTICAL  ANALYSIS  OUTPUT  (CONCLUDED) 


I&TAL 

STANDARD  DEVIATIONS 

3.SF3 

3,58n 

C9RRELATIBNS 

1O00 
•1796 

.1796 

i  .ooo 

a  I  THIN 

STANDARD  DEVIATIONS 
?«B37 

3.1-69 

LeRRELATIRNS 

l«r.C'J 
-•2?:7 

-»2?07 

1  »ooo 

bETWEFN 

STANDARD  DEVIATIONS 
2«4-.8» 

1  .e66 

CSRRELATIBNS 

1  «003 
•  9793 

.9793 
1.000 

PAIR^ISE  DISTANCES 
CLASS            1 
17.31 
4.766 
7.37* 

*.766 
.*734 
2.710 

7.374 
2»710 

10.40 

CENTtw  TP  MEAN 
DISTANCE 

CLASS            1 
4.1*1 

? 
.6881 

3 
3.??5 

DIRECTION  C9SINES 
CLASS            1 
l'OQO 
-•86c9 
-•9931 

? 
-.8609 
1«C0G 
.7956 

3 
-.9931 
.79P6 
1*000 

JIRECTI8N  AN-.LES 
CLASS            \ 

•oooc 

149.4 
173.3 

? 

1*9«  4 

•  ocoo 

37*29 

1  73'3 
37.29 

•  ooco 

METHOD   1 

: 

INVERSE 

<1  -  1 

<2  -  1 

DET  *  58.55553H294 

1    2   .3648 
INVERSE 
<1  -  1 
<2  •  1 
DET  «  ?S?«83l?9636 

•fcl?9E-Cl 

.8*6c£"01 

3  -.3233       . 1  SIC       .758?E-ri 


INVERSE 

<1  *  1 

<2  »  1 

JET  .  84.558??798? 

2    3   1»Q76       •9239E-'.!l   •3776F-01 
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Columns  three  and  four  are  the  input  identification  number  (ID)  and  object 
type  number  (TY).     Columns  five,   six  and  seven  are  information  used  in 
sorting  and  code  check  and  are  not  important  for  classifier  design.     Column 
eight  (CL)  is  the  class  number  for  the  vector  and  is  derived  by  applying  the 
TYPE  to  CLASS  conversion  defined  by  the  input  "four"  card  to  the  values  in 
the  column  headed  "TY".     The  column  headed  "SCORE"  contains  the  values  of 
feature  number  1.     These  appear  in  increasing  order,   since  the  ordering 
was  done  on  this  feature.     The  columns  headed  "O",   "l",   "2",   "3"  relate 
to  sample  in  classes  1,   2  and  3  and  sample  vectors  that  were  not  assigned 
a  class  number  (class  "O").     Since  all  of  the  vectors  were  given  class  num- 
bers,   there  are  no  entries  in  column  "O".     The  other  columns  are  to  be 
interpreted  in  the  following  way:    The  three  smallest  values  of  feature  1 
appear  in  vectors  from  class  1.     This  is  shown  by  the  values  1,2,3  in  col- 
umn 1.     Looking  at  the  column  headed  "NO",  we  see  that  these  are  vectors 
1,  6  and  5  and  the  score  column  shows  the  values  of  feature  1  to  be  3,  4  and 
4,   respectively.     The  vector  from  class  2  with  the  smallest  value  for  fea- 
ture 1  is  vector  number     7  and  has  the  value  5.     There  are  also  five  vectors 
from  class  1  with  this  same  value,   as  shown.     The  listing  continues  in  this 
way  to  show  how  the  samples  from  each  class  are  ordered  by  feature  1. 
This  particular  tradeoff  listing  shows  that  the  three  classes  are  shuffled 
together  pretty  well  along  feature  1  and  that  this  feature  may  not  be  of  much 
help  in  classifying  the  data.     Table  23,    the  tradeoff  on  feature  2,   shows  that 
there  is  some  potentially  useful  structure  in  this  dimension.     The  listing 
shows  that  there  are  eight  vectors  from  class  1  and  six  vectors  from  class  3 
that  have  small  values  of  feature  2.     Then,    in  order,   all  the  vectors  from 
class  2  appear  (mixed  with  three  vectors  from  class  1)  having  intermediate 
values  of  feature  2.     Finally,    the  remaining  seven  samples  from  class  3 
form  a  cluster  with  large  values  for  feature  3  and  one  maveric  from  class  1 
lies  with  them.     The  tradeoff  listings  can  be  used  in  this  way  to  obtain  the 
same  kinds  of  information  as  can  be  obtained  from  a  histogram. 
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Tables  20  and  21  are  another  kind  of  tradeoff  listing  where,    instead  of  listing 
the  order  of  the  samples,    the  entire  feature  vector  is  printed.     The  heading 
for  Table  20  is  "TRADEOFF  FOR  FEATURE  NUMBER  -l".     The  value  "1" 
indicates  the  feature  that  is  used  to  order  the  listing  and  the  minus  sign 
indicates  that  the  listing  shows  the  feature  values  rather  than  the  class 
ordinal  values.     The  first  four  columns  of  this  listing  are  the  same  as  for 
the  previous  listings.     The  columns  headed  "1",   "2",   etc.    contain  the  values 
for  features  1,   2,   etc.     On  this  listing,   all  10  columns  are  used,   regardless 
of  how  many  features  the  samples  have. 

The  listing  of  feature  vectors  ordered  by  the  magnitude  of  feature  2  (see 
Table  23)  showed  that  the  type  6  (assigned  to  class  3)  vectors  (points)  were 
of  two  distinct  sub-types;  that  is,   of  the  13  type-6  vectors,    six  had  a  value 
of  feature  2  between  4  and  6  inclusive,   and  the  other  seven  had  a  value  of 
feature  2  between  13  and  16  inclusive.     As  a  result  of  this  discovery,   a 
fourth  type  was  defined  (type  7)  for  the  vectors  of  type  6  with  feature  2  values 
between  13  and  16.     The  cards  for  these  samples  were  changed  by  punching 
a  7  in  field  3.     The  type  column  in  the  listings  shows  this  change. 

The  classifier  portion  of  the  program  calculated  equations  for  three  lines 
to  be  used  in  separating  the  data  into  three  classes.     It  may  seem  redundant 
to  ask  the  program  to  separate  data  classes  where  each  point  has  already 
been  defined  as  belonging  to  a  certain  class,   but  the  establishment  of 
boundaries  allows  the  classification  of  new  points,    of  unknown  class,   by 
determining  where  the  new  points  lie  with  respect  to  the  previously  defined 
boundaries.     It  may  be  said  that  this  first  step,    this  establishment  of 
boundaries,    is  a  learning  step,   or  an  assessment  of  known  data,    to  allow 
future  data  to  be  properly  classified. 
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The  class  separation  lines  calculated  by  the  classifier  are  shown  plotted 
along  with  the  data  in  Figure  13.    [The  Method  1  classifier,   used  for  this 
test  case,   finds  pairwise  boundaries;  that  is,    it  finds  a  line  to  separate  a 
pair  of  classes,   then  a  line  for  another  pair,   etc.  ,   until  all  possible  pairs 
have  been  treated.     For  pairwise  boundaries  between  N  classes,  the  number 
of  pairs,   and  the  number  of  lines,    is        2~     •  ^    ^  aPPears  from  the  figure 
that  these  lines  do  very  little  in  separating  classes.     Note,   however,    that, 
if  the  pair  of  classes  to  be  separated  is  projected  onto  the  normal  to  the 
program's  calculated  line  for  that  pair,    the  displacement  of  a  projected 
point  along  that  normal  is    related  to  its  class.     The  program  calls  this 
displacement  a  "score"  and  lists  the  "score"  for  every  feature  vector  as 
part  of  the  tradeoff  listing.     (This  effect  is  most  pronounced  in  Figure  13 
for  the  class  pair  1:2;  separation  of  class  3  is  more  difficult  because  it  has 
two  parts.  )    Another  view  is  to  say  that  the  optimum  lines  are  parallel  to, 
but  displaced  from,    the  calculated  pairwise  boundaries.     By  using  coefficient 
cards  ("two"  cards),    these  lines  may  be  shifted  to  become  the  optimal  pair- 
wise  boundaries.     This  is    equivalent  to  adding  a  biasing  value  to  all  "scores", 
and  letting  the  boundary  be  equal  to  a  score  of  zero.     The  way  that  the 
scores  are  related  to  the  boundary  and  the  sample  locations  is  shown  in 
Figure  14  for  an  arbitrary  boundary  line. 

A  second  run  of  the  program  was  made,   with  changes  to  treat  the  two  groups 
within  type  6  as  separate.     The  type  7  was  defined  as  previously  discussed, 
and  assigned  to  class  4  using  a  class  assignment  control  card  ("four"  card). 
The  feature  vector  input  cards  ("one"  cards)  for  the  type  7  vectors  were 
changed  to  reflect  the    new  type.     Thus,    there  were  four  types  (4,    5,    6,   7) 
assigned  to  four  classes  (1,   2,   3,  4).     Again,    the  program  calculated 
statistics,    this  time  for  four  classes,    listed  feature  vectors  ordered  by 
feature  1  and  feature  2,   and  calculated  equations  for  lines  to  be  used  in 
separating  the  four  classes.     These  lines  are  shown  in  Figure  15.     Because 
of  the  way  the  program  computes  these  lines,    two  of  them  are  not  within  the 
scope  of  Figure  15,   and  have  been  represented  in  the  figure  by  their  slopes. 
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Figure  13.     Test  Case  One  Data 
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Figure  14.     Method  of  Scoring  from  Boundary  Location 
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This  is  adequate  to  allow  finding  a  normal  line  to  each  one,   and  changes 
only  the  relative  value  of  the  score  for  a  given  feature  vector.     Determining 
class  membership  thus  becomes  a  matter  of  selecting  a  threshold,   or  bound- 
ary value  of  the  score  with  a  class  above  the  threshold  and  another  below. 
It  may  be  seen  (Figure  16)  that  feature  2  itself  could  be  used  as  a  "score", 
with  thresholds  at  feature  2  =  6  and  feature  2  =  12.      In  fact,   were  it  not  for  the 
vectors  in  class  1  (type  4),    this  classification  test  case  could  be  solved 
using  only  the  feature  2  values  as  scores.     The  program  assigns  a  larger 
weighting  value  to  feature  2  (with  this  data  set)  because  it  is  a  good  separator. 

It  may  also  be  seen  that  feature  1  could  be  used  to  separate  classes  1  and  3 
if  the  threshold  were  chosen  at  feature  1  =  10.  5;  one  error  would  occur  in 
this  case  (vector  27  would  be  misplaced  in  class  3). 

The  "score"  may  be  thought  of  as  being  the  dot  product  of  two  vectors, 
namely  the  feature  vector  and  the  vector  normal  to  the  program-calculated 
boundary  line.     Alternatively,    the  score  is  formed  by  summing  a  portion  of 
feature  1  plus  a  portion  of  feature  2  plus  a  constant.     In  either  case,   by 
determining  a  score  for  a  given  vector,    that  vector  may  be  represented  by 
a  single  value  (score)  instead  of  by  two  values  (feature  1  and  feature  2). 

It  is  possible  to  determine  several  different  scores  for  a  given  vector  by 
selecting  different,   non-parallel  boundary  lines.     For  example,    the  boundary 
between  classes  1  and  2  produces  a  set  of  scores  for  the  data  set,   while  the 
boundary  between  classes  3  and  4  produces  another  score  set.     This  should 
not  be  confused  with  the  phenomenon  of  many  different  parallel  "boundary" 
lines  between  two  classes,   since  in  the  case  of  many  parallel  "boundaries" 
all  the  score  sets  differ  only  by  a  constant  biasing  value  (see  Figure  14). 
In  other  words,   any  program-calculated  boundary  defines  a  score  set,   by 
projecting  the  vectors  onto  the  normal  to  this  program-calculated  boundary. 
In  the  same  manner,   any  two  program-calcula.ted  boundaries  define  two 
score  sets.     If  the  two  program-calculated  boundaries  are  parallel,    the 
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score  sets  are  equivalent  to  each  other,  but  are  offset  from  each  other  by 
some  bias  value.     If  the  two  program -calculated  boundaries  are  not  parallel, 
no  amount  of  biasing  applied  to  either  score  set  will  make  the  score  sets 
equivalent. 

Thus,  a  given  feature  vector  may  be  represented  by  a  single  "score"  instead 
of  by  its  component  feature  values.     (This  is  true  for  the  N-dimensional  case 
as  well  as  for  the  two-dimensionsl  case  under  discussion. )    Several  non- 
equivalent  score  sets  may  initially  be  required;  these  can  then  be  treated  as 
"features"  and  combined  to  produce  a  final,   single  score  set  which  will  allow 
classification  of  feature  vectors  by  appropriately  selecting  threshold  values 
(boundary  values).     In  the  case  under  discussion  here,   the  second  run 
produced  six  pair-wise  boundaries,  along  with  a  set  of  39  scores  for  each 
boundary. 

The  computer  runs  referred  to  in  the  following  discussion  are  the  result  of 
processing  two  additional  control  card  decks,  using  the  data  cards  that  were 
modified  to  show  type  7  vectors.     The  discussion  of  these  results  is  easier 
when  the  two  runs  are  merged,   thus  the  complete  listings  are  not  given  in 
order,  as  was  done  for  the  run  discussed  above.     The  two    runs  are  labelled 
"DATE  610  ID  TCI  BMl"  and  "DATE  626  ID  TCI  CM3",   respectively,   and 
this  label  appears  at  the  top  of  each  page  of  output.     These  labels  are 
included  in  the  figures  for  those  who  wish  to  sort  them  out. 

Table  25  is  the  lead-off  listing  for  the  first  run.     The  first  few  lines  of  this 
listing  give  the  control  cards  that  were  used,  followed  by    the  parameters 
input  from  data  cards.     The  LCOUNT  and  NPCON  values  are  generated  by 
the  program  and  are  output  for  reference  at  the  time  they  are  determined. 
The  next  line  "EXECUTE"  indicates  that  the  "-99"  card  was  encountered. 
The  items  listed  to  the  line  "FEATURE  VECTORS"  are  values  generated  by 
the  program  in  response  to  input  cards.     Next  follows  a  listing  of  the  feature 
vectors  as  they  were  read  from  the  input  cards  and  finally  a  summary  of  the 
number  of  samples  assigned  to  each  class. 

126 
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Table  26  is  similar  to  Table  2  5  with  the  exception  that  the  pair  wise  bound- 
aries determined  by  the  previous  run  have  been  input  as  parameter  cards 
(the  "2"  cards)  as  shown.     These  parameters  are  used  to  transform  the  input 
features  and  the  results  of  this  are  listed  in  the  second  feature  listing. 

Near  the  top  of  Table  27,   below  the  label  "COEFF,"  the  coefficients  for  the 
1,  2  -boundary  are  listed.     The  three  values  given  are  the  additive  constant, 
the  feature  1  multiplier  and  the  feature  2  multiplier.     The  scores  are 
obtained  by  applying  these  coefficients  to  the  feature  values. 

The  tradeoff  listings  of  scores  for  the  class  pair  discriminants  show  that 
class  membership  may  be  determined  by  selecting  suitable  thresholds. 
This  is  the  first  step  in  using  the  logical  mode  classifier.     Table  27  shows 
the  scores  produced  by  the  data  set  when  projected  onto  the  normal  to  the 
discriminant  between  class  1  and  class  2.     Note  that  all  class  4  points  have 
scores  of  2.  0843  or  greater,   and  that  any  feature  vector  (point)  with  a  score 
less  than  2.  0843  (for  this  discriminant)  is  not  in  class  4.     A  logical  variable 
may  be  defined  as  the  score  values  for  this  discriminant  minus  2.  08,    in 
which  case  all  class  4  vectors  will  show  a  positive  score,   and  ail  non-class  4 
vectors  will  show  a  negative  score.     This  logical  variable  is  shown  as  a 
tradeoff  listing  in  Table  28.     Score  values  in  Table  28  are  different  from 
those  in  Table  27  because  of  the  way  the  new  variable  was  defined  (must  be 
an  integer  value)  but  the  phenomenon  is  clear.     A  new  feature  has  been 
defined  as:    the  score  from  Table  27  minus  2.  0617,    that  difference  then 
multiplied  by  1000  to  create  an  integer  value  with  sufficient  precision  to 
discriminate.     The  new  integer  feature  is  what  is  shown  as  a  score  in 
Table  26.     In  the  logical  mode,   features  greater  than  zero  (positive)  are 
called  true,  while  features  equal  to  or  less  than  zero  (negative)  are  called 

false.     Thus,    the  feature  of  Table  28  is  true  only  for  vectors  (points)  of 
class  4.     Other  logical  features  may  be  similarly  defined;  for  example  the 
scores  for  the  discriminant  between  classes  2  and  3  is  shown  in  Table  29. 
A  new  logical  variable  was  defined  by  subtracting  2.  6603  from  each  score 
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TABLE  26.     LISTING  INCLUDING  THE  TRANSFORMED  FEATURES 


Date 
LC3UN 


•  7 

•  7 


?•!  .2 

I'l-  0 
?»1'3 
3'1  ,0 


39 


EXECLTr 
f\AG<  1  ) 
NFv    ■    39 
NC    «    « 
NT    .    7 
NF    .    2 
kl-.pDE     .    3 
PR9B 

•3077     .3590 
TYPE       1     ?    3    *    5    <• 
CLAS       0    ~    0    1     ?    3 
SELECTED    FEATljSES 

1       2 
FEATURE    vECT«o<; 


.3-3*3. 

•?.    PS- 
•1-.6.7 
0.-. 1.2.3. 


.-,"H59 

:  »755 

•  3    567 


1538    -1735 
5*7 


i 
?. 


7 
8 
9 
10 
11 
1? 
13 
1* 
15 
16 
17 
IS 
13 
83 
21 
22 
23 
2* 
25 
26 
27 
28 
29 
30 
31 
32 


13 
1 
2 
3 


10 
1  1 
lr 
13 
1* 
15 
If. 
17 
18 
19 
20 
21 
?2 
23 
21 
25 
?6 
27 
28 
29 
30 
31 
32 


2„ 
21 
22 
23 
2» 
25 
26 
27 
28 
29 
3o 
3) 
3? 


CL 


0 

1 

3 

4. 

0 

.  Z 

7 

5 

3 

0 

»  r 

" 

n 

5 

<. 

0 

.  ; 

■) 

- 

5 

5 

0 

i  z 

z 

0 

<. 

5 

0 

»   o 

- 

0 

J. 

9 

o 

.  r 

5 

7 

0 

- 

r. 

5 

13 

r 

"5 

6 

l: 

0 

,   c 

" 

z 

7 

7 

0 

i   0 

0 

z 

8 

5 

0 

.   - 

z 

z 

? 

8 

0 

.  Z 

' 

z 

8 

9 

0 

.   J 

z 

" 

8 

U 

0 

.  r 

Z- 

z 

8 

15 

0 

C, 

-. 

z 

9 

1 

0 

0 

1 

-1 

10 

6 

0 

i   C 

r» 

r 

13 

8 

0 

►   0 

r. 

z 

10 

11 

0 

.   0 

j 

-i 

10 

13 

0 

i   0 

z 

0 

11 

5 

c 

.   0 

z 

0 

11 

9 

0   i 

c 

z 

n 

11 

10 

0 

0 

n 

0 

11 

1* 

0 

c 

"J 

0 

11 

15 

0   i 

0 

0 

0 

12 

7 

0   i 

0 

o 

n 

12 

8 

0   . 

c 

0 

0 

12 

U 

0 

0 

0 

0 

12 

It 

0 

c 

c 

0 

13 

4 

0 

0 

o 

c 

13 

8 

0   . 

0 

0 

0 

13 

10 

9  ,0 

0  3 

0  0 

0  0 

0  3 

0  0 

0  0 

o  o 

0  0 

0  3 

0  0 

0  3 

0  0 

0  0 

o  o 

o  o 

0  0 

0  0 

0  0 

0  0 

0  0 

0  3 

0  3 

3  0 

0  3 

0  3 

3  0 

3  3 

3  3 

3  0 

0  0 

0  3 

0  0 
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TABLE  26.     LISTING  INCLUDING  THE  TRANSFORMED 
FEATURES  (CONCLUDED) 


33 

33 

7 

? 

33 

C 

0 

•   0 

0 

C 

13 

13 

0 

0 

0 

0 

0 

0 

0 

0 

30 

34 

6 

2 

3« 

0 

0 

»   0 

1 

0 

1* 

5 

0 

0 

0 

0 

0 

0 

0 

0 

35 

35 

5 

2 

35 

n 

0 

.   0 

Q 

0 

14 

9 

0 

o 

0 

0 

0 

c 

0 

0 

36 

36 

7 

? 

36 

0 

0 

t   0 

0 

0 

14 

16 

0 

0 

0 

0 

0 

c 

c 

0 

37 

37 

6 

2 

37 

0 

0 

.   0 

n 

0 

15 

6 

0 

0 

0 

0 

0 

0 

0 

0 

38 

38 

6 

2 

38 

r. 

0 

.   0 

0 

0 

16 

5 

0 

c 

0 

0 

0 

0 

0 

0 

39 

39 

6 

2 

39 

0 

0 

•   0 

3 

0 

16 

6 

0 

0 

0 

0 

0 

0 

0 

0 

CBEf F ICIENT 
<  T   <P    f 

C»R5S 

QMST 

11000 

•1« 

697 

6198E- 

t  1   -8 

»59E- 

01 

21000 

•  3131. 

• 

»5-.7E- 

rl     -.1 

»75 

31000 

-2. 

1?8 

, 

3961E- 

-2   .3 

■57 

fE*TuHE 

VECT 

OBS 

NB 

10 

TV 

NF 

CI 

1 

2 

3 

4 

5 

6 

7 

8 

9 

]0 

1 

1 

4 

9 

1 

( 

0 

•   0 

3 

7 

•1172 

-151 

-793 

0 

0 

o 

0 

0 

Q 

0 

2 

2 

It 

2 

? 

j 

0 

.  c 

c 

0 

-1132 

86 

-1091 

0 

0 

0 

0 

0 

€ 

0 

3 

3 

It 

? 

3 

7- 

0 

»   0 

0 

c 

-1048 

-«■:■ 

-785 

0 

0 

c 

0 

0 

3 

0 

« 

it 

It 

? 

4 

0 

.  c 

0 

0 

-963 

-208 

-479 

0 

1 

3 

0 

0 

0 

0 

5 

5 

4 

2 

5 

■J 

c 

»   r 

0 

Q 

-1025 

-253 

-483 

c 

0 

3 

0 

0 

0 

0 

6 

6 

4 

p 

6 

0 

i   0 

"2 

0 

-687 

-843 

738 

o 

0 

0 

0 

0 

0 

0 

7 

7 

e 

2 

7 

c 

0 

.   0 

0 

0 

-794 

-503 

131 

0 

0 

0 

0 

0 

0 

0 

8 

8 

It 

2 

8 

n 

0 

.   0 

3 

0 

-286 

-1388 

1965 

o 

n 

0 

0 

0 

0 

c 

9 

9 

R 

2 

9 

0 

0 

i   0 

7 

o 

.478 

-901 

1052 

0 

0 

-) 

0 

0 

c 

0 

10 

10 

it 

2 

1" 

r 

0 

i   0 

r 

0 

-670 

-413 

139 

0 

A 

o  . 

0 

0 

0 

0 

11 

11 

l| 

? 

U 

3 

0 

.   0 

0 

1 

.777 

-73 

-467 

0 

0 

o 

o 

0 

0 

0 

1? 

1? 

R 

2 

12 

3 

0 

.   0 

n 

0 

-523 

-515 

449 

o 

- 

n 

0 

c 

0 

0 

13 

13 

R 

? 

13 

r 

0 

.   0 

0 

A 

.439 

-663 

754 

c 

0 

o 

3 

0 

o 

0 

14 

14 

c 

2 

H 

3 

0 

0 

0 

0 

-270 

-958 

1366 

0 

fl 

0 

0 

0 

0 

0 

15 

15 

7 

2 

15 

c 

0 

■   0 

') 

0 

68 

-1548 

25H8 

o 

3 

-1 

0 

c 

0 

0 

16 

16 

it 

2 

16 

0 

0 

c 

r* 

0 

-SCO 

119 

-769 

0 

0 

o 

o 

0 

0 

0 

17 

17 

* 

2 

17 

o 

0   i 

c 

0 

0 

-569 

-13; 

-154 

c 

0 

0 

0 

c 

o 

0 

18 

18 

K 

2 

18 

0 

0 

0 

1 

Q 

-399 

-425 

457 

0 

- 

3 

0 

0 

0 

0 

19 

19 

r 

? 

19 

0 

0 

0 

n 

0 

-146 

-86» 

1374 

0 

0 

o 

0 

0 

0 

J 

20 

20 

7 

2 

20 

0 

0 

o 

.-> 

0 

23 

■1163 

1985 

0 

3 

- 

o 

c 

0 

0 

21 

21 

t 

? 

21 

9 

0 

i   0 

t 

c 

-591 

61 

-456 

0 

" 

0 

0 

0 

c 

0 

22 

22 

K 

2 

22 

c 

0  . 

0 

-> 

n 

-'53 

-525 

766 

o 

0 

o 

0 

z, 

c 

3 

23 

23 

5 

2 

23 

0 

0 

0 

i 

j 

-168 

-675 

1072 

o 

0 

0 

o 

0 

0 

0 

2<t 

?4 

7 

2 

Sit 

0 

0   i 

c 

,) 

3 

169 

-1266 

2294 

0 

0 

0 

0 

0 

c 

0 

25 

25 

7 

2 

25 

c 

0   i 

0 

3 

3 

254 

-1413 

2^00 

n 

o 

o 

o 

0 

0 

0 

26 

26 

* 

2 

26 

o 

0  . 

0 

- 

3 

-360 

-188 

159 

0 

r. 

0 

I 

0 

0 

0 

27 

27 

4 

2 

27 

0 

0   . 

o 

i 

n 

-275 

-335 

464 

0 

0 

o 

; 

0 

0 

0 

28 

28 

e 

2 

28 

0 

0   . 

0 

rj 

0 

-22 

-77? 

13S1 

0 

0 

0 

0 

0 

0 

0 

29 

29 

7 

2 

29 

r 

0   . 

n 

Q 

0 

231 

-122: 

2?9» 

c 

0 

0 

0 

0 

0 

o 

30 

30 

6. 

2 

3; 

1 

0   . 

c 

i 

0 

-552 

299 

-753 

c 

1 

p 

o 

0 

0 

0 

31 

31 

c 

2 

31 

0 

0   . 

0 

o 

o 

-213 

-29c 

468 

0 

0 

r 

0 

o 

0 

3 

32 

32 

c 

2 

32 

(. 

0  . 

0 

'j 

A 

-44 

-585 

1080 

p 

o 

0 

o 

0 

c 

3 

33 

33 

7 

2 

33 

3 

0   . 

c 

3 

0 

209 

-102? 

1997 

c 

0 

o 

0 

0 

c 

2 

3* 

31 

<■ 

2 

3-4 

c 

0   . 

0 

0 

0 

.405 

197 

-444 

0 

0 

A 

o 

0 

o 

'J 

35 

35 

R 

2 

35 

r 

0   . 

r 

0 

1 

-67 

-393 

778 

0 

c 

3 

o 

0 

c 

z 

36 

36 

7 

2 

36 

) 

0   . 

0 

0 

o 

524 

-1425 

2118 

0 

0 

o 

~ 

0 

0 

o 

37 

37 

6 

2 

37 

0 

0   . 

0 

o 

1 

-259 

yo 

-•.34 

o 

o 

o 

0 

0 

Q 

3 

38 

38 

6 

2 

38 

; 

0   i 

0 

0 

0 

-281 

2*7 

-436 

0 

n 

o 

0 

0 

3 

3 

39 

39 

t 

? 

39 

o 

0   . 

c 

0 

0 

-197 

139 

-130 

0 

0 

0 

c 

0 

0 

0 

PREP 


SELECTED    SampL-'S 
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TABLE  27.     TRADEOFF  FOR  PAIR  1,  2 


DATE 

610  ID 

TC1B 

Ml 

TRADEOFF  FOR 

PAIR 

1   2 

C6EFF 

• 

36483 

•06198 

•08459 

NB 

ID 

TY 

Cl 

SCORE 

0   1 

2 

3 

4 

1 

1 

1 

4 

1 

0 

0 

•  8891 

1 

2 

2 

2 

4 

2 

0 

0 

•9285 

2 

3 

3 

3 

4 

3 

0 

0 

•0131 

3 

4 

5 

5 

4 

5 

0 

0 

•0357 

4 

5 

4 

4 

4 

4 

0 

0 

•  0977 

5 

6 

16 

16 

4 

16 

0 

0 

•  2610 

6 

7 

7 

7 

5 

7 

0 

0 

2 

•  2669 

1 

8 

11 

11 

4 

11 

0 

0 

•2836 

7 

9 

6 

6 

4 

6 

0 

0 

•  3741 

8 

10 

10 

10 

4 

10 

0 

0 

•  3908 

9 

11 

21 

21 

6 

21 

0 

0 

3 

►  4696 

1 

12 

17 

17 

4 

17 

0 

0 

1 

•  4922 

10 

13 

30 

30 

6 

30 

0 

c 

3 

'5089 

2 

1* 

12 

12 

5 

12 

0 

0 

2 

'5374 

2 

15 

9 

9 

5 

9 

0 

0 

2 

•  5826 

3 

16 

13 

13 

5 

13 

0 

0 

2 

►  6220 

4 

17 

34 

34 

6 

34 

0 

0 

3 

►  6555 

3 

18 

18 

18 

5 

18 

0 

0 

2 

►  6614 

5 

19 

26 

26 

5 

26 

0 

0 

2 

•7007 

6 

20 

8 

8 

4 

8 

0 

0 

1 

►  7744 

11 

21 

38 

38 

6 

38 

0 

0 

3 

•  7795 

4 

22 

27 

27 

4 

27 

0 

0 

1 

•  7853 

12 

23 

1* 

1* 

5 

14 

0 

0 

2 

.7912 

7 

24 

37 

37 

6 

37 

0 

0 

3 

'8o21 

5 

25 

22 

22 

5 

22 

0 

0 

2 

'8079 

8 

26 

31 

31 

5 

31 

0 

0 

2 

.8473 

9 

27 

39 

39 

6 

39 

0 

0 

3 

.8641 

6 

28 

23 

23 

5 

23 

0 

c 

2 

.8925 

10 

29 

19 

19 

5 

19 

0 

0 

2 

.9151 

11 

30 

35 

35 

5 

35 

0 

0 

2 

.9939 

12 

31 

32 

32 

5 

32 

0 

0 

2 

2< 

•  0165 

13 

32 

28 

28 

5 

28 

0 

0 

2 

2. 

'0391 

14 

33 

20 

20 

7 

20 

0 

0 

4 

2< 

•  0843 

1 

34 

15 

15 

7 

15 

0 

0 

4 

2< 

'1295 

2 

35 

24 

24 

7 

24 

0 

0 

4 

2< 

'2309 

3 

36 

33 

33 

7 

33 

0 

0 

4 

2< 

•  2703 

4 

37 

29 

29 

7 

29 

0 

0 

4 

2< 

•  2929 

5 

38 

25 

25 

7 

25 

0 

0 

4 

2< 

.3155 

6 

39 

36 

36 

7 

36 

0 

0 

4 

2< 

►  5860 

7 
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TABLE  28.     TRADEOFF  FOR  FEATURE  NUMBER  1 


DATE 

626  ID 

TC1C 

*3 

TRADE9F   f  m 

FEATURE 

NUMBEf-? 

1 

N8 

ID 

TY 

CI 

SC9RE 

0   1 

2 

3 

4 

1 

1 

1 

4 

1 

0 

0 

-1172*0000 

1 

2 

2 

2 

4 

2 

0 

0 

-1132*0000 

2 

3 

3 

3 

4 

3 

0 

0 

-10^8*0000 

3 

4 

5 

5 

4 

5 

0 

0 

-1025*0000 

4 

5 

4 

4 

4 

k 

0 

0 

-963*0000 

5 

6 

16 

16 

4 

16 

0 

0 

-800*0000 

6 

7 

7 

7 

5 

7 

0 

0 

2 

-794*0000 

1 

8 

11 

11 

4 

11 

0 

0 

-777*0000 

7 

9 

6 

6 

4 

6 

0 

0 

-6*7*0000 

8 

10 

10 

10 

4 

10 

c 

0 

-670*0000 

9 

11 

21 

21 

6 

21 

0 

0 

3 

-591 *0000 

1 

12 

17 

17 

4 

17 

0 

0 

1 

-569*0000 

10 

13 

30 

30 

6 

30 

0 

0 

3 

-552*0000 

2 

1* 

12 

12 

5 

12 

0 

0 

2 

-523*0000 

2 

15 

9 

9 

5 

9 

0 

0 

2 

-478*0000 

3 

16 

13 

13 

5 

13 

0 

0 

2 

-439*0000 

4 

17 

34 

34 

6 

34 

0 

o 

3 

-405*0000 

3 

18 

18 

18 

5 

18 

0 

c 

2 

-399*0000 

5 

19 

26 

26 

5 

26 

0 

0 

2 

-360*0000 

6 

20 

8 

8 

4 

8 

0 

0 

1 

•286*0000 

11 

21 

38 

38 

6 

38 

0 

0 

3 

•281*0000 

4 

22 

27 

?7 

4 

27 

0 

0 

1 

•275*0000 

12 

23 

14 

14 

5 

14 

0 

0 

2 

-270*0000 

7 

2^ 

37 

37 

6 

37 

0 

0 

3 

-259*0000 

5 

25 

22 

22 

5 

22 

0 

0 

2 

•253*0000 

8 

26 

31 

31 

5 

31 

0 

0 

2 

•213*0000 

9 

27 

39 

39 

6 

39 

0 

0 

3 

•197*0000 

6 

28 

23 

23 

5 

23 

0 

0 

2 

•168*0000 

10 

29 

19 

19 

5 

19 

0 

0 

2 

-146*0000 

11 

30 

35 

35 

5 

35 

0 

0 

2 

•67*0000 

12 

31 

32 

32 

5 

32 

0 

0 

2 

-44*0000 

13 

32 

28 

28 

5 

28 

0 

0 

2 

-22*0000 

14 

33 

20 

20 

7 

20 

0 

0 

4 

23*0000 

1 

34 

15 

15 

7 

15 

0 

0 

4 

68*0000 

2 

35 

24 

24 

7 

24 

0 

0 

4 

169*0000 

3 

36 

33 

33 

7 

33 

0 

0 

4 

209*0000 

4 

37 

29 

29 

7 

29 

0 

0 

4 

231*0000 

5 

38 

25 

25 

7 

25 

0 

0 

4 

254*0000 

6 

39 

36 

36 

7 

36 

0 

0 

4 

524*0000 

7 
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TABLE  29.      TRADEOFF  FOR  PAIR  2,  3 


DATE 

610  ID 

TC13 

vl 

TRADE9FF  F0R 

PAIR 

2   3 

C8EFF 

2« 

96373 

•04507 

- 

•14755 

N8 

ID 

TY 

CL 

SC^RE 

0   1 

2 

3 

4 

1 

15 

15 

7 

15 

0 

0 

4 

•1111 

1 

2 

36 

36 

7 

36 

C 

r\ 

4 

•2339 

? 

3 

25 

25 

7 

25 

0 

c 

4 

•  2463 

P 

4 

8  ' 

8 

4 

b 

0 

r 

1 

'271C 

1 

5 

24 

24 

7 

24 

c 

r. 

4 

•  3938 

U 

6 

29 

29 

7 

29 

c 

0 

4 

•  4389 

5 

7 

20 

20 

7 

20 

0 

4 

•  4963 

<■> 

8 

33 

33 

7 

33 

0 

0 

4 

•6315 

7 

9 

14 

14 

5 

14 

0 

0 

2 

•7ol3 

1 

10 

9 

9 

5 

9 

1 

0 

2 

•  7587 

p 

11 

19 

19 

5 

19 

0 

0 

2 

•7914 

3 

12 

6 

'  6 

4 

fc 

0 

0 

1 

•8161 

2 

13 

28 

28 

5 

28 

0 

0 

2 

•  8815 

4 

1* 

23 

?3 

5 

23 

o 

c 

2  , 

»9«40 

5 

■ 

15 

13 

13 

5 

13 

c 

0 

2 

.9964 

6 

16 

32 

32 

5 

32 

0 

0 

P 

P< 

•0741 

7 

17 

22 

22 

5 

22 

0 

0 

2 

P< 

•1316 

8 

18 

12 

12 

5 

12 

0 

0 

2 

2< 

•  1439 

9 

19 

7 

7 

5 

7 

0 

c 

2 

2« 

•1562 

10 

20 

18 

18 

5 

18 

0 

0 

2 

2< 

•2340 

U 

21 

10 

10 

4 

10 

0 

0 

1 

?c 

•  2464 

3 

22 

35 

35 

5 

35 

0 

0 

2 

?« 

.2668 

12 

23 

27 

27 

4 

27 

0 

0 

1 

2< 

.3242 

4 

24 

31 

31 

5 

31 

0 

0 

2 

2< 

.3692 

13 

25 

5 

5 

4 

5 

0 

0 

1 

2. 

.4q63 

5 

26 

4 

4 

4 

4 

0 

0 

1 

?< 

.4513 

6 

27 

26 

26 

5 

26 

0 

0 

2 

2< 

.4717 

14 

28 

1 

1 

4 

1 

0 

0 

1 

2< 

.5^,87 

7 

29 

17 

17 

4 

17 

o 

0 

1 

2< 

-5291 

8 

30 

11 

11 

4 

11 

c 

0 

1 

2< 

•  5865 

9 

31 

3 

3 

4 

3 

0 

0 

1 

2' 

.5989 

10 

32 

21 

21 

6 

21 

0 

o 

3 

p  , 

.7217 

1 

33 

2 

2 

4 

2 

0 

0 

1 

2< 

.7464 

11 

34 

37 

37 

6 

37 

0 

0 

3 

2« 

.7545 

2 

35 

16 

16 

4 

16 

0 

0 

1 

9  i 

.7792 

12 

36 

39 

39 

6 

39 

0 

0 

3 

2' 

•  7995 

3 

37 

34 

34 

6 

34 

0 

0 

3 

2' 

.8569 

4 

38 

38 

38 

6 

38 

0 

0 

3 

2< 

.9471 

5 

39 

30 

30 

6 

30 

0 

0 

3 

2< 

.9594 

6 
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(and  multiplying  by  1000  to  produce  integers);  it  is  shown  in  Table  30  and  is 
true  for  feature  vectors  in  class  3  (with  two  errors;  unfortunately  this  seems 
the  best  separation  of  class  3  that  is  possible).     The  third  variable  to  be  used 
for  the  logical  mode  classifier  was  formed  from  the  scores  on  the  discrim- 
inant between    class  2  and  class  4  (see  Table  31)  by  placing  a  threshold  at 
1.3349  (see  Table  32). 

Having  defined  these  three  logical  variables,  which  the  program  will  call 
"true"  if  they  are  positive  and  "false"  if  not,   a  table  may  be  constructed 
showing  all  possible  combinations  of  these  three  logical  variables  and  the 
resulting  class.     It  is  shown  in  Table  33.     While  all  states  (combinations) 
in  Table   33  are  logically  possible,   four  of  the  states  do  not  occur  for  this 
data  set  with  the  thresholds  selected  as  described.     For  example,  no  single 
feature  vector  will  produce  a  logically  true  value  in  all  three  score  listings, 
because  of  the  data  distribution  and  threshold  selections.     The  other  "dis- 
allowed" states  happen  for  the  same  reason:    for  instance,   no  feature  vector 
has  logical  variable  1  as  false  when  logical  variables  2  and  3  are  true. 

The  errors  in  classes  2  and  3  occur  because  of  the  imperfections  in  the 
discriminants  calculated  by  the  method  1  classifier.     This  is  a  fault  of  the 
data  distribution  and  not  of  the  program  itself.     This  may  be  partially  cor- 
rected by  defining  additional  logical  variables  (up  to  a  total  of  10)  using  the 
same  technique  as  before;  however,   each  new  logical  variable  doubles  the 
number  of  logically  possible  states  in  Table  33.     One  of  these  additional 
logical  variables  could  be  defined  by  placing  a  threshold  at  1.  875  in  Table  27. 
This  separates  five  vectors  in  class  2  from  the  rest  of  the  data  set,   and 
would  produce  eight  new  possible  states  in  Table  33.     There  would  then  be 
class  2  vectors  in  more  than  a  single  state  of  Table  33;  these  states  then 

would  need  to  be  combined  in  some  manner  to  give  a  single  "output"  for  any 
class  2  vector.     The  technique  of  combining  logical  states  is  discussed  else- 
where,   in  the  section  concerning  Karnaugh  mapping. 

The  classifier  program  produces  a  unique  number  for  each  logical  state  of 
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TABLE  30.     TRADEOFF  FOR  FEATURE  NUMBER  2 


'J  ATE 

62*  ID 

TClC 

"3 

TRADbSFF  FflR 

FEATURE 

NU^ 

3ER 

N6 

ID 

TY 

1 

15 

15 

7 

lb 

0 

2 

36 

36 

7 

36 

0 

3 

25 

25 

7 

25 

r\ 

4 

8 

8 

4 

8 

0 

5 

24 

24 

7 

24 

0 

6 

29 

29 

7 

29 

0 

7 

20 

20 

7 

?a 

0 

8 

33 

33 

7 

33 

r 

9 

14 

14 

5 

14 

n 

1C 

9 

9 

5 

9 

Q 

11 

19 

19 

5 

19 

c 

1? 

6 

6 

4 

6 

vj 

13 

28 

28 

5 

2? 

r> 

1* 

23 

?3 

5 

23 

0 

15 

13 

13 

5 

13 

0 

1* 

32 

32 

5 

3<? 

0 

17 

22 

22 

5 

?2 

o 

18 

12 

12 

5 

12 

0 

19 

7 

7 

5 

7 

0 

20 

18 

18 

5 

1? 

0 

21 

10 

10 

4 

10 

c 

22 

35 

35 

5 

3b 

0 

23 

27 

27 

4 

27 

c 

24 

31 

31 

5 

31 

0 

25 

5 

5 

4 

5 

c 

26 

4 

4 

4 

4 

*\ 

27 

26 

26 

5 

26 

c 

28 

1 

1 

4 

1 

0 

29 

17 

17 

4 

17 

0 

30 

11 

11 

4 

11 

0 

31 

3 

3 

4 

3 

0 

32 

21 

21 

6 

21 

c 

33 

2 

2 

4 

2 

0 

34 

37 

37 

6 

37 

0 

35 

16 

16 

4 

16 

c 

36 

39 

39 

6 

39 

0 

37 

34 

34 

6 

34 

0 

38 

38 

38 

6 

38 

0 

39 

30 

30 

6 

30 

0 

cu 


D 

4 

~\ 

1 

r- 

4 

0 

4 

o 

4 

r 

4 

(-. 

2 

2 

0 

? 

0 

1 

0 

2 

0 

2 

r 

2 

0 

2 

0 

2 

C 

2 

0 

2 

0 

d 

C 

i 

0 

2 

0 

1 

c 

*-< 
c 

c 

1 

c 

1 

0 

P 

c 

1 

0 

1 

c 

1 

0 

1 

0 

3 

0 

1 

0 

3 

T; 

1 

0 

3 

0 

3 

0 

3 

0 

3 

sce«F 

;>  1 

1 5  4  8 1 

0000 

14?5« 

0000 

14-13. 

\j  0  0  u 

13R*« 

0000 

1 

12*6. 

ocoo 

122:). 

0000 

1163. 

'0000 

1  028. 

oooc 

-9C*  < 

0000 

-9-1  « 

•oooo 

-868* 

'OOOC 

-343. 

'0000 

3 

-77». 

'OCOO 

-675. 

'0000 

-6^3. 

•ocoo 

-5*5« 

•0000 

«5?8< 

•0000 

-515. 

'0000 

-503« 

'0000 

-425< 

'0000 

-413, 

•0000 

3 

-393, 

•  0000 

-335, 

•  oooo 

4 

-2^0  « 

'OOOC 

-253. 

►  0000 

5 

-20*  < 

►0000 

6 

-188, 

•  oooo 

-151  < 

•  oooo 

7 

-130' 

'0000 

8 

-73, 

'0000 

9 

-60< 

oooo 

10 

61 

•  oooo 

86 

►  oooo 

11 

94 

•oooo 

119 

■OOOC 

12 

139 

■  oooo 

197 

►  oooo 

2*7 

■  oooo 

299 

•  oooo 

1 

2 
3 

4 
5 
6 
7 
« 

9 

10 

11 

12 
13 


14 


4 
1 
? 

3 

4 
5 
6 

7 


3 
4 
5 
6 
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TABLE  31.     TRADEOFF  FOR  PAIR  2,4 


DATE   610  ID 
TRADE9FF  FQR 

PAIR     2   4 


TC18M1 


C9EFF 


*  • 

69355 

#00396 

•30567 

N9 

ID 

TY 

ct 

SCQRt 

0   1 

2 

3   4 

1 

2 

2 

4 

2 

0 

0 

1 

►  2433 

1 

2 

1 

1 

4 

1 

0 

0 

1 

•  5410 

2 

3 

3 

3 

4 

3 

0 

0 

1 

.5489 

3 

4 

16 

16 

4 

16 

0 

0 

1 

►  5648 

4 

5 

30 

30 

6 

30 

0 

0 

3 

►  5806 

1 

6 

5 

5 

4 

5 

0 

0 

1 

•8507 

5 

7 

4 

4 

4 

4 

0 

0 

1 

►  8546 

6 

8 

11 

11 

4 

11 

c 

0 

1 

►  8665 

7 

9 

21 

21 

6 

21 

0 

0 

3 

►  8784 

2 

10 

34 

34 

6 

34 

0 

0 

3 

►  8902 

3 

11 

38 

38 

6 

38 

0 

0 

3 

►  8982 

4 

12 

17 

17 

4 

17 

0 

0 

1 

1 

•1801 

8 

13 

37 

37 

6 

37 

0 

0 

3 

1 

►  1999 

5 

1* 

39 

39 

6 

39 

0 

0 

3 

1 

•2038 

6 

15 

7 

7 

5 

7 

0 

0 

2 

1 

•  4660 

1 

16 

10 

10 

4 

10 

0 

0 

1 

1 

►  4739 

9 

17 

26 

26 

5 

26 

0 

0 

2 

1 

•  4937 

2 

18 

12 

12 

5 

12 

0 

0 

2 

1 

►  7835 

3 

19 

18 

18 

5 

18 

0 

0 

2 

1 

•  7914 

4 

?0 

27 

27 

4 

27 

0 

o 

1 

1' 

►  7993 

10 

21 

31 

31 

5 

31 

0 

0 

2 

1 

►  8o33 

5 

22 

6 

6 

4 

6 

0 

0 

1 

2« 

►  0733 

11 

23 

13 

13 

5 

13 

0 

n 

2 

2< 

►  0892 

6 

2* 

22 

22 

5 

22 

0 

0 

2 

2< 

•1011 

7 

25 

35 

35 

5 

35 

0 

0 

2 

2< 

•1129 

8 

26 

9 

9 

5 

9 

0 

0 

2 

2< 

►  3869 

9 

27 

23 

23 

5 

23 

0 

0 

2 

2< 

•4067 

10 

28 

32 

32 

5 

32 

0 

0 

2 

2. 

'4147 

11 

29 

14 

14 

5 

14 

0 

0 

2 

2< 

•  7C05 

12 

30 

19 

19 

5 

19 

0 

0 

2 

2< 

'7084 

13 

31 

28 

28 

5 

28 

0 

0 

2 

2< 

'7164 

14 

32 

8 

8 

4 

8 

0 

0 

1 

3« 

•3000 

12 

33 

20 

20 

7 

20 

0 

0 

4 

3« 

'3l98 

1 

34 

33 

33 

7 

33 

0 

0 

4 

3< 

•3317 

2 

35 

24 

24 

7 

24 

0 

0 

4 

3« 

,6294 

3 

36 

29 

P9 

7 

29 

c 

0 

4 

3< 

'6334 

4 

37 

15 

15 

7 

15 

0 

0 

4 

3< 

•  9232 

5 

38 

25 

25 

7 

25 

0 

c 

4 

3< 

'9351 

6 

39 

36 

36 

7 

36 

0 

0 

4 

4. 

•2527 

7 
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TABLE  32.      TRADEOFF  FOR  FEATURE  NUMBER  3 


DATE 

626  ID 

TC1C"3 

TRADEOFF  FOR 

feature: 

NUMBER 

3 

N9 

ID  ' 

TY 

1 

CL 

1 

2 

2 

4 

2 

0 

0 

1 

2 

1 

1 

4 

1 

0 

0 

1 

3 

3 

3 

4 

3 

0 

0 

1 

4 

16 

16 

4 

16 

0 

0 

1 

5 

30 

30 

6 

3C 

0 

0 

3 

6 

5 

5 

4 

5 

0 

0 

1 

7 

4 

4 

4 

4 

0 

0 

1 

8 

11 

11 

4 

11 

0 

0 

1 

9 

21 

21 

6 

21 

0 

0 

3 

10 

3^ 

34 

6 

34 

0 

0 

3 

11 

38 

38 

6 

38 

0 

0 

3 

12 

17 

17 

4 

17 

0 

0 

1 

13 

37 

37 

6 

37 

0 

0 

3 

1* 

39 

39 

6 

39 

0 

0 

3 

15 

7 

7 

5 

7 

0 

0 

2 

16 

10 

10 

4 

10 

0 

0 

1 

17 

26 

26 

5 

26 

0 

0 

2 

18 

12 

12 

5 

12 

0 

0 

2 

19 

18 

18 

5 

18 

0 

0 

2 

20 

27 

27 

4 

27 

0 

0 

1 

21 

31 

31 

5 

31 

0 

0 

2 

22 

6 

6 

4 

6 

0 

0 

1 

23 

13 

13 

5 

13 

0 

0 

2 

2* 

22 

22 

5 

22 

c 

0 

2 

25 

35 

35 

5 

35 

0 

0 

2 

26 

9 

9 

5 

9 

0 

0 

2 

27 

23 

23 

5 

23 

0 

0 

2 

28 

32 

32 

5 

32 

0 

0 

2 

29 

1^ 

14 

5 

14 

0 

0 

2 

30 

19 

19 

5 

IS 

0 

0 

2 

31 

28 

28 

5 

28 

0 

0 

2 

32 

8 

8 

4 

8 

0 

0 

1 

33 

20 

20 

7 

20 

0 

0 

4 

3* 

33 

33 

7 

33 

0 

0 

4 

35 

24 

P4 

7 

24 

0 

c 

4 

36 

29 

29 

7 

29 

0 

0 

4 

37 

15 

15 

7 

15 

0 

0 

4 

38 

25 

25 

7 

25 

0 

0 

4 

39 

36 

36 

7 

36 

0 

0 

4 

SC9RE 
■1091 *0000 
•793*0000 
-785.Q000 
-769.Q000 
•753.0000 
-483*0000 
-479.0000 
-467.0000 
-456»0000 
•444.0000 
-436.0000 
-154*0000 
-134.0000 
•130»0000 
131*0000 
139*0000 
159*0000 
449.Q000 
457*0000 
464.0000 
468.0000 
738*0000 
754.0000 
766.0000 
778*0000 
1052*0000 
1072*0000 
1080*0000 
1366*0000 
1374*0000 
1381 *0000 
1965*0000 
1985*0000 
1997*0000 
2294*0000 
22q8*0000 
2588*0000 
2600*0000 
2918*0000 


1 
1 
2 
3 

4 

5 
6 
7 


S 


2      3 


10 
11 


12 


2 
3 

4 


6 
7 

8 
9 
10 
11 
12 
13 

14 


2 

3 

4 

5 
6 


1 
2 

3 
k 
5 
6 

7 
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TABLE  33.     POSSIBLE  COMBINATIONS  OF  THREE  LOGICAL  VARIABLES 


Logical 
Variable  1 

Logical 
Variable  2 

Logical 
Variable  3 

True 

True 

True 

True 

True 

False 

True 

False 

True 

True 

False 

False 

False 

True 

True 

False 

True 

False 

False 

False 

True 

False 

False 

False 

Class 

♦-State  does  not  occur 
♦-State  does  not  occur 
4 

-State  does  not  occur 
-State  does  not  occur 
3  (with  2  errors) 
2  (with  4  errors) 
1 


Table  33  by  substituting  a  digit  "l"  for  the  value  "true,  "  and  digit  "0"  for 
the  value  "false.  "    The  table  then  appears  as  shown  below. 


Logi 
Varia 

.cal 
ble  1 

Logical 
Variable  2 

1 

Logical 
Variable  3 

1 

Octal 
Number 

7 

Class 

1 

D.  N.  O. 

1 

1 

0 

6 

D.  N.  O. 

1 

0 

1 

5 

4 

1 

0 

0 

4 

D.  N.  O. 

0 

1 

1 

3 

D.  N.  O. 

0 

1 

0 

2 

3  (with  errors) 

0 

0 

1 

1 

2  (with  errors) 

0 

0 

0 

0 

1 

For  the  listmg  shown  in  TabLe  34,    the  logical  variables  are  combined  into 
an  octal  number,   as  shown  in  the  table  above. 
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TABLE  34.     LOGICAL  TRADEOFF  FOR  TEST  CASE  1 


DATE 

626  ID  TC1C 

M3 

LC8UM 

T  .  3 

NB 

ID 

TY 

Cl 

SCORE"     ( 

3   1 

2 

3 

4 

1 

17 

17 

4 

17 

0 

0 

03000000 

1 

2 

11 

11 

4 

11 

0 

0 

oeooocoo 

2 

3 

5 

5 

4 

5 

0 

c 

oooooooo 

3 

4 

4 

4 

4 

4 

0 

0 

ooooocoo 

4 

5 

3 

3 

4 

3 

0 

0 

oooooooo 

5 

6 

1 

1 

4 

1 

0 

c 

oooooooo 

6 

7 

35 

35 

5 

3b 

0 

c 

2 

oooooooi 

1 

8 

32 

32 

5 

32 

0 

0 

2 

00000001 

2 

9 

31 

31 

5 

31 

o 

0 

oooooool 

3 

10 

28 

28 

5 

28 

0 

0 

2 

0000000 1 

4 

11 

27 

27 

4 

27 

0 

0 

1 

00000001 

7 

12 

26 

26 

5 

26 

0 

0 

p 

00000001 

5 

13 

23 

23 

5 

23 

0 

2 

00000001 

6 

14 

22 

22 

5 

22 

c 

0 

2 

00000001 

7 

15 

19 

19 

5 

19 

0 

0 

2 

0000000 1 

8 

16 

18 

18 

5 

18 

c 

0 

2 

oooooool 

9 

17 

14 

14 

5 

14 

0 

0 

2 

0000000 1 

10 

18 

13 

13 

5 

13 

0 

0 

2 

COOOOOOl 

11 

' 

19 

12 

12 

5 

12 

0 

2 

oooooool 

12 

20 

10 

10 

4 

10 

0 

0 

1 

oooooool 

3 

21 

9 

9 

5 

9 

0 

c 

2 

oooooool 

13 

22 

8 

8 

4 

8 

0 

0 

1 

oooooool 

9 

23 

7 

7 

5 

7 

c 

0 

2 

oooooool 

14 

24 

6 

6 

4 

6 

0 

0 

1 

oooooool 

10 

25 

39 

39 

6 

39 

0 

0 

3 

00000002 

1 

26 

38 

38 

6 

38 

c 

3 

00000002 

2 

27 

37 

37 

6 

37 

c 

0 

3 

00000002 

3 

28 

34 

34 

6 

34 

0 

o 

3 

00000002 

4 

29 

30 

30 

6 

30 

0 

0 

2 

OrC00002 

5 

30 

21 

21 

6 

21 

o 

0 

3 

0C000O02 

6 

31 

16 

16 

4 

16 

c 

0 

1 

00000002 

11 

32 

2 

2 

4 

c 

0 

0 

1 

00000002 

12 

33 

36 

36 

7 

36 

c 

0 

4 

00000005 

1 

3* 

33 

33 

7 

33 

n 

0 

4 

0000000  5 

? 

35 

29 

29 

7 

29 

r. 

4 

00000005 

3 

36 

25 

25 

7 

25 

0 

0 

4 

00000005 

4 

37 

24 

24 

7 

24 

0 

o 

4 

00000005 

5 

38 

20 

20 

7 

20 

c 

0 

4 

00000005 

6 

39 

15 

15 

7 

15 

0 

c 

4 

00000005 

7 
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TEST  CASE  2 

A  second  test  case  was  developed;  the  data  from  test  case  one  was  modified 
by  including  a  third  feature  for  each  feature  vector  (data  point),    thus  pro- 
viding a  three-dimensional  data  set  for  classification. 

Two  program  runs  were  made  initially,   one  using  the  method  1  classifier 
(Table  35)  and  another  using  method  2  (Table  36).     The  pairwise  class 
boundaries  were  not  the  same  for  the  two  methods,   but  the  errors  were 
approximately  equal.     One  class  was  not  separated  into  two  or  more  sub- 
classes as  had  been  done  in  the  two-dimensional  test  case,   since  the 
additional  feature  in  the  three-dimensional  case  tended  to  unify  the  class 
which  had  appeared  split  in  two  dimensions,   as  shown  by  the  scores  deter- 
mined for  each  pairwise  class  boundary. 

Using  the  pairwise  class  boundary  scores  from  the  method  1  and  method  2 
runs,   with  suitable  threshold  values,    the  method  3  (logical  mode)  classifier 
was  executed  with  six  logical  variables.     The  result  was  ten  distinct  groups 
of  features  (out  of  2     =64  possible  groups)  with  a  unique  octal  score  for  each 
group.     (Octal  is  a  number  system  with  eight  as  its  base,    instead  of  a  base 
of  10,   as  in  the  decimal  system.  )    The  controls  and  results  are  shown  in 
Table  37. 

The  three  classes  were  divided  among  these  ten  groups  in  such  a  way  that 
seven  of  the  groups  contained  vectors  of  a  single  class,   while  in  three  of 
the  groups,   more  than  one  class  was  represented.     By  combining  these 
groups,    the  three  original  classes  may  be  recovered;  any  subsequent 
vector  is  then  assigned  an  octal  score  which  determines  which  group  it  is 
in,    thus  also  assigning  the  vector  to  its  proper  class.     The  task  of  combining 
these  10  groups  logically  into  the  original  classes  is  facilitated  by  a  tech- 
nique called  Karnaugh  mapping,   which  will  be  discussed  briefly. 
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TABLE  3  5.     TEST  CASE  2  PROGRAM  OUTPUTS,    MODE  1 


-ATE 
LCSIA 


511     10    frsc*?*) 


-PCS". 


-3  5»«>»7 

•6  0 

-7  1 

-7  2 

•7  3 

.»  0 

3  3.1?/!".. 

13 

•  6<C»0'.-» 

1<? 

5  3<l/2«3 

txECuTF 

FLAGtl)  •  39 

•Fv  ■  39 

-C  •  3 

'lT  .  6 

^F  •  3 

<M90t  •  1 

F"<RB 

•3077  .3590  .3333 

'YPE   1  ?  3  »  5  is 

Cl*s  o  o  3  1  '   3 

^ELECTED  FEATURES 

1   ?   3 

FEATJKE  VECTORS 

N«         13  TV  MF 

1      1  *  ■» 

1 

2        3   t   3 

2 

3        3   k   3 

3 

8 

8 

k 

3 

h 

9 

9 

c 

3 

3 

10 

10 

k 

3 

1.- 

11 

11 

k 

? 

U 

1? 

12 

C 

3 

lr 

13 

13 

C 

3 

13 

Ik 

Ik 

C 

3 

Ik 

15 

15 

6 

3 

15 

16 

16 

k 

3 

U 

17 

17 

k 

3 

17 

18 

18 

K 

3 

It- 

19 

19 

C 

3 

19 

20 

20 

6 

3 

p  -« 

21 

21 

f 

3 

21 

22 

?2 

c 

3 

22 

23 

23 

c 

3 

23 

2k 

?k 

f 

3 

2k 

25 

25 

6 

3 

2= 

26 

?6 

c 

3 

?<■ 

27 

27 

k 

3 

27 

28 

?8 

R 

3 

28 

29 

2=> 

6 

3 

2° 

30 

30 

f 

3 

3: 

31 

31 

c 

3 

31 

32 

3P 

C 

3 

3? 

33 

33 

6 

3 

33 

3k 

3k 

6 

-! 

3k 

35 

35 

3 

35 

36 

36 

6 

3 

36 

37 

37 

6 

3 

37 

38 

38 

6 

3 

3* 

39 

39 

t- 

■3 

3a 

rR£0 

=ELECTCD 

SAI- 

"V-. 

s 

C.ASb 

? 

oM6t« 

: 

1  = 

1 

k 

1 

? 

3 

to 

5 

3 

k 

12 

C 

C 

? 

3 

Ik 

r 

0 

5 

k 

11 

0 

0 

5 

5 

9 

n 

0 

k 

5 

10 

0 

0 

k 

9 

a 

0 

n 

5 

7 

10 

0 

C 

5 

13 

k 

0 

0 

6 

10 

9 

3 

3 

7 

7 

h 

0 

0 

8 

5 

1  3 

0 

n 

8 

a 

3 

0 

0 

8 

9 

5 

r 

n 

8 

11 

10 

0 

3 

8 

15 

5 

0 

0 

3 

it 

<5 

0 

0 

n 

6 

a 

0 

0 

10 

a 

k 

0 

0 

10 

11 

12 

c 

0 

10 

13 

3 

3 

1 

n 

c 

16 

0 

0 

n 

-) 

6 

0 

3 

n 

1 ; 

9 

n 

0 

n 

!» 

7 

3 

*> 

u 

15 

12 

C 

0 

12 

7 

a 

? 

" 

12 

a 

6 

0 

0 

12 

H 

7 

0 

10 

12 

Ik 

5 

0 

0 

13 

k 

1  k 

0 

0 

13 

a 

7 

0 

0 

13 

10 

5 

3 

0 

13 

13 

15 

0 

•• 

Ik 

c 

15 

3 

0 

Ik 

9 

6 

C 

c 

Ik 

16 

10 

n 

0 

15 

*. 

10 

a 

3 

16 

5 

K 

c 

0 

16 

6 

7 

0 

0 
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TABLE  35.     TEST  CASE  2  PROGRAM  OUTPUTS,   MODE  1  (CONTINUED) 


DATE   511  ID  TESCA2Aj 
TRADEOFF  F9R 
PAIR     1   2 


C9EFF 


t 

09475 

NIB 

1 

1 

2 

2 

3 

3 

4 

5 

5 

4 

6 

16 

7 

7 

8 

10 

9 

11 

10 

6 

11 

12 

12 

17 

13 

13 

1* 

18 

15 

9 

16 

21 

17 

30 

18 

8 

19 

26 

20 

27 

21 

22 

22 

38 

23 

34 

2* 

14 

25 

31 

26 

37 

27 

39 

28 

23 

29 

35 

30 

32 

31 

20 

32 

19 

33 

28 

34 

15 

35 

24 

36 

29 

37 

25 

38 

33 

39 

36 

.06771  .09176     .02103 

ID  TY  CI 

14  10  0  1 

2  4  2.0  01 

3  4  3  0  0  1 

5  4  5  0  0  1 

4  4  4  0  0  1 

16  4  16  0  0  1 

7  5  7  0  0  2 

10  4  lo  0  0  1 

11  4  U  0  0  1 

6  4  6  0  0  1 

12  5  12  o  0  2 

17  4  17  0  0  1 

13  5  13  0  0  2 

18  5  18  0  0  2 
9  5  9  0  0  2 

21  6  21  0  0  3 

30  6  30  0  0  3 

8  4  8  0  0  1 

26  5  26  0  0  2 

27  4  27  0  0  1 

22  5  22  0  0  2 

38  6  38  0  0  3 

34  6  34  0  0  3 

14  5  Ik  0  0  2 

31  5  31  0  0  2 
37  6  37  C  0  3 

39  6  39  0  0  3 

23  5  23  0  0  2 

35  5  35  0  0  2 

32  5  32  0  0  2 
20  6  20  0  0  3 

19  5  19  0  0  2 

28  5  28  0  0  2 

15  6  15  0  0  3 

24  6  24  0  0  3 

29  6  29  0  0  3 

25  6  25  0  0  3 

33  6  33  0  0  3 

36  6  36  0  0  3 


SCORE 
•  9173 

1«0030 
1*0317 
1*0347 
1*0814 
1*1763 
1*2859 
1*3372 
1 *3476 
1 .3597 
1*4336 
1 .4906 
1*5674 

1 *5900 
1*6079 
1 »6348 
1*6364 
1*7103 
l*7i78 
1*7675 
1*7916 
l*8o51 
1 «8l69 
1*8561 
1 »8563 
1*8712 
1*8759 
1  .9464 
1 .9947 
1  .9977 
2*0278 
2*0336 
2*0638 
2*1180 
2*2714 

2*2970 
2*4683 
2*4833 
2*7211 


1 
1 
2 
3 
4 
5 
6 

7 

8 
9 

10 


2   3 


11 
12 


3 

4 
5 


8 
9 


10 
11 
12 

13 
14 


1 
2 


3 
4 


5 
6 


8 
9 

10 

H 

13 
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TABLE  3  5.     TEST  CASE  2  PROGRAM  OUTPUTS.    MODE  1  (CONTINUED) 


DATE 

511  ID 

TESCA2A1 

TRADEOFF  F8R 

PAIR 

1   3 

C6EFF 

-It 

0*813 

•17126 

•099F? 

• 

06737 

N8 

ID 

TY 

CL 

SC0SF 

0   1 

P 

3 

1 

1 

1 

4 

1 

0 

0 

1 

•6721 

1 

2 

5 

5 

4 

5 

n 

•J 

1 

»8r8l 

2 

3 

4 

4 

4 

4 

0 

3 

1 

•9i2C 

3 

4 

3 

3 

4 

3 

n 

0 

1 

•  9472 

4 

5 

2 

2 

4 

2 

0 

0 

1 

1  ' 

•  Q498 

5 

6 

6 

6 

4 

6 

0 

0 

1 

1' 

•0715 

6 

7 

7 

7 

5 

7 

c 

0 

2 

1« 

•1784 

1 

8 

16 

16 

4 

16 

r\ 

r 

u 

1 

1  < 

►2?8l 

7 

9 

10 

10 

4 

10 

0 

0 

< 

i« 

►  2515 

3 

10 

12 

12 

5 

12 

c 

0 

? 

i< 

•  3202 

p 

11 

8 

8 

4 

8 

0 

0 

1 

i « 

►3714 

9 

12 

13 

13 

5 

13 

c 

r\ 

2 

i  < 

•  5544 

3 

13 

9 

9 

5 

9 

•J 

0 

2 

i  « 

►  5*09 

4 

14 

11 

11 

4 

11 

0 

0 

1 1 

•6279 

10 

15 

18 

18 

5 

18 

0 

0 

2 

i  < 

►7300 

5 

16 

17 

17 

4 

17 

V 

0 

1 

i 

•  8o05 

11 

17 

1* 

1* 

5 

14 

0 

2 

2 

•0903 

6 

18 

22 

22 

5 

22 

0 

2 

P< 

►1355 

7 

19 

15 

15 

6 

lb 

0 

c 

3 

p. 

•1515 

1 

20 

20 

20 

6 

20 

0 

n 

3 

P< 

►  1603 

2 

21 

27 

P7 

4 

27 

0 

0 

1 

2« 

•  2-73 

12 

22 

26 

26 

5 

26 

0 

0 

2 

p< 

•2425 

8 

23 

21 

21 

6 

21 

0 

0 

3 

p  , 

►  Mil 

3 

24 

23 

23 

5 

23 

f> 

2 

2< 

►  437? 

9 

25 

31 

31 

5 

31 

0 

0 

2 

p, 

.4459 

lo- 

26 

32 

32 

5 

32 

0 

0 

p( 

►  5102 

ll 

27 

30 

30 

6 

30 

0 

r» 

3 

P< 

•  5l94 

4 

28 

19 

19 

5 

19 

b 

? 

2< 

•5675 

1? 

29 

28 

28 

5 

28 

0 

0 

2 

2« 

►  5732 

13 

30 

35 

35 

5 

35 

c 

0 

P 

P« 

.6493 

14 

31 

2* 

?4 

6 

24 

0 

0 

3 

2< 

►  7qo5 

5 

32 

38 

38 

6 

38 

0 

0 

3 

P< 

•  7p85 

6 

33 

29 

29 

6 

29 

0 

0 

3 

P< 

►737C 

7 

3* 

39 

39 

6 

39 

0 

0 

3 

2 

•  7606 

S 

35 

37 

37 

6 

37 

c 

^» 

3 

P 

•7915 

9 

36 

34 

34 

6 

34 

o 

0 

3 

2 

•  SF75 

l-> 

37 

25 

25 

6 

25 

0 

0 

3 

3« 

•1369 

ii 

38 

33 

33 

6 

33 

0 

0 

3 

3 , 

.if  9p4 

l2 

39 

36 

36 

6 

36 

c 

0 

3 

3< 

.6i§4 

13 
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TABLE  35.     TEST  CASE  2  PROGRAM  OUTPUTS,    MODE  1  (CONCLUDED) 


LATE 

511  ID 

TESCA2A1 

TRADEOFF  FQR 

PAIR 

2   3 

C6EFF 

• 

67539 

•  08 

M3 

•04786 

t 

04697 

N9 

ID 

TY 

CL 

SC8^F 

0   1 

2 

3 

1 

1 

1 

4 

1 

0 

0 

1 

1 

•  6828 

1 

2 

5 

5 

4 

5 

0 

0 

1 

1 

'7209 

2 

3 

4 

4 

4 

4 

0 

0 

1 

1 

►7581 

3 

4 

3 

3 

4 

3 

0 

0 

1 

1 

•8o41 

4 

5 

6 

6 

4 

6 

0 

0 

1 

1 

.8184 

5 

6 

16 

16 

4 

16 

0 

0 

1 

1 

.8589 

6 

7 

12 

12 

5 

12 

c 

0 

2 

1 

•8722 

1 

8 

10 

10 

4 

1C 

0 

0 

1 

1 

'8811 

7 

9 

2 

2 

4 

2 

r, 

0 

1 

1 

•8972 

8 

10 

7 

7 

5 

7 

0 

0 

2 

1 

»9o07 

2 

11 

8 

8 

4 

8 

r 
v. 

0 

1 

1 

'90-61 

9 

12 

13 

13 

5 

13 

0 

c 

2 

2 

•  0140 

3 

13 

9 

9 

5 

9 

0 

2 

2 

'0815 

4 

1* 

18 

18 

5 

18 

pi 

Q 

2 

2 

•  0874 

5 

15 

11 

11 

4 

11 

0 

0 

1 

2 

'1514 

1C 

16 

17 

17 

4 

17 

0 

0 

1 

2. 

•  1796 

11 

17 

20 

20 

6 

20 

0 

0 

3 

2< 

.2798 

1 

18 

15 

15 

6 

15 

0 

0 

3 

2« 

'3011 

2 

19 

22 

22 

5 

22 

0 

0 

2 

2< 

'3i34 

6 

20 

14 

14 

5 

14 

0 

0 

2 

?! 

•  3446 

7 

21 

27 

27 

4 

27 

c 

0 

1 

2. 

.3497 

12 

22 

26 

26 

5 

26 

n 

0 

2 

2« 

.3957 

8 

23 

31 

31 

5 

31 

c 

0 

2 

2< 

.4808 

9 

?* 

32 

32 

5 

32 

/"■ 

0 

2 

?< 

.4825 

10 

25 

23 

23 

5 

23 

0 

0 

2 

2. 

'5C-21 

U 

26 

28 

28 

5 

28 

0 

0 

2 

?« 

•  5402 

12 

?7 

35 

35 

5 

35 

0 

0 

2 

2' 

•  5658 

13 

28 

29 

29 

6 

29 

0 

c 

3 

?. 

'5898 

3 

29 

21 

21 

6 

21 

0 

0 

3 

?i 

-5917 

4 

30 

24 

?4 

6 

24 

0 

0 

3 

5 , 

.5996 

5 

31 

19 

19 

5 

19 

0 

0 

2 

2< 

.6068 

14 

32 

30 

30 

6 

3C 

0 

0 

3 

2< 

.6181 

6 

33 

38 

38 

6 

38 

0 

0 

3 

2< 

.6366 

7 

34 

39 

39 

6 

39 

c 

0 

3 

2< 

'6374 

8 

35 

37 

37 

6 

37 

0 

0 

3 

2' 

'6942 

9 

36 

34 

34 

6 

34 

0 

0 

3 

2< 

'7971 

10 

37 

25 

25 

6 

25 

0 

0 

3 

p , 

8*23 

ll 

38 

36 

36 

6 

36 

0 

0 

3 

3« 

0887 

i'2 

39 

33 

33 

6 

33 

0 

0 

3 

3« 

0958 

'3 
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TABLE  36.     TEST  CASE  2  PROGRAM  OUTPUTS,    MODE  2 


->ATE      51 


1     ID    TESC»S2* 
-2 


5<6,7 

0 

1 

2 

3 

0 


3«i2»it, 

6<C<0»0' 
3.1.  2.  ■» 


13 
1.?. 


EXECUTE 

FLAG(l) 

.  39 

^Fv  •  35 

NC  •  3 

\T  •  6. 

<-F  .  3 

i"80t  • 

? 

PRflB 

.3077  . 

3590 

•  3333 

TYPE   1 

2  3 

t  5 

6 

CIAS   0 

Z    0 

1  ? 

3 

SELECTEC 

FEATURES 

1   ? 

3 

FEATt'OE 

vECT 

*>=JS 

M3 

13 

TV 

MP 

1 

1 

It 

3 

1 

2 

2 

4 

3 

J 

3 

3 

It 

3 

3 

1 

it 

it 

3 

it 

5 

5 

it 

3 

? 

6 

6 

it 

3 

6 

7 

7 

c 

3 

7 

8 

8 

it 

3 

f> 

9 

9 

c 

3 

a 

10 

10 

it 

3 

lc 

11 

11 

it 

3 

u 

12 

12 

5 

3 

12 

13 

13 

5 

1 

13 

1* 

It 

c 

3 

In 

15 

15 

6 

3 

15 

16 

16 

it 

3 

16 

17 

17 

it 

3 

17 

18 

18 

5 

3 

lc 

19 

19 

c 

3 

19 

20 

20 

6 

3 

?0 

21 

21 

t 

3 

2) 

22 

22 

e 

3 

22 

23 

23 

c 

3 

23 

2t 

2" 

(■ 

3 

Jit 

25 

25 

6 

3 

25 

26 

?6 

c 

3 

26 

27 

27 

u 

3 

27 

28 

28 

c 

3 

2f 

29 

29 

6 

3 

29 

30 

30 

6 

3 

3; 

31  ' 

31 

c 

3 

31 

32 

32 

5 

3 

3? 

33 

33 

6 

3 

33 

3* 

3t 

6 

■a 

34 

35 

35 

c 

3 

3; 

36 

36 

6 

3 

36 

37 

37 

6 

3 

37 

35 

38 

6 

3 

3E 

39 

39 

ik 

3 

39 

H«EP 

^ELECTED 

SAM 

»LE 

S 

Class 

- 

1 

3 

\JMB£* 

1» 

lit 

0 

» 

1 

3 

0 

>  z 

1 

r 

5 

0 

t   c 

"• 

* 

5 

0 

.  1 

"* 

z 

5 

0 

t   c 

- 

z 

4 

0 

i   0 

"; 

^ 

it 

0 

,  o 

• 

" 

5 

0 

.   0 

z 

r 

5 

c 

t  c 

0 

6 

0 

»   0 

z 

*> 

7 

0 

•  c 

c 

r 

8 

0 

t   0 

0 

0 

8 

0 

t   C 

z 

z 

8 

0 

.   0 

z 

c 

8 

0 

»   ? 

0 

o 

8 

0 

t   C 

r 

z 
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n 

o 

12 
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0 

0 

12 

0 
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0 

0 

12 

0 
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0 

c 

13 

0 
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; 

c 

13 

0 
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0 

n 

13 

0 
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0 

13 
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- 

-. 

r 

It 

0  . 

1' 

z 

r 

It 
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z 

" 

^ 

U 

0   . 

o 

- 

o 

15 
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c 

3 

16 
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c 

"■ 

- 

16 
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1-, 


9 
11 

15 
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13 

5 

9 
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It 
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7 

8 
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It 


10 

13 


9 
16 
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12 

It 

11 

9 

10 
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5 

13 
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5 


12 
3 
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6 

i: 
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TABLE  36.     TEST  CASE  2  PROGRAM  OUTPUTS,    MODE  2  (CONTINUED) 


UATE 

511  ID 

TESC*S2A 

TRADE8FF  F9R 

Pair 

1   2 

CQEFF 

-3« 

25535 

. 09*19 

•30950 

• 

19911 

NQ 

ID 

TY 

CL 

SC9«E 

0   1 

2 

3 

1 

16 

16 

4 

16 

0 

0 

1 

•»  * 

•1378 

1 

2 

4 

4 

4 

4 

u' 

1 

•5754 

2 

3 

12 

12 

5 

12 

■  c 

0 

2 

»6o38 

1 

4 

3 

3 

4 

3 

0 

0 

1 

>6f>4l 

3 

5 

1 

1 

4 

1 

0 

0 

1 

►  6668 

4 

6 

5 

5 

4 

5 

0 

0 

1 

►  6763 

5 

7 

10 

10 

4 

10 

0 

0 

1 

►  7934 

6 

8 

2 

2 

4 

2 

0 

0 

1 

•9519 

7 

9 

18 

18 

5 

18 

0 

0 

2 

►  9993 

2 

10 

17 

17 

4 

17 

0 

0 

1 

•1767 

S 

11 

13 

13 

5 

13 

0 

0 

2 
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3 

12 

7 

7 

5 

7 

0 

0 

2 

•3935 

4 

13 

38 

38 
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38 

0 

0 

3 

•  4564 

1 

1* 

11 

11 

4 

11 

0 

0 

1 
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9 

15 

6 

6 

4 

6 

0 

0 

1 

•  5161 

10 

16 

39 

39 

6 

39 

0 

0 
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27 
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4 
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11 
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26 

26 

5 

26 
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5 

19 

22 

22 

5 

22 

c 
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6 

20 

31 

31 

5 

31 

0 

0 

2 
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7 

21 

30 

30 

6 

30 

c 

0 

3 

2< 

•  0470 

3 
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8 

8 

4 

8 

0 

0 

1 

2< 
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12 

23 

37 

37 
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37 

0 

3 

2« 
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4 

?4 

35 

35 

5 

35 

0 

0 

2 

2< 

►  0998 

? 

25 

32 

32 

5 

32 

0 

c 

2 

2. 
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9 
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9 

9 

5 

9 

0 

0 

2 

2< 
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10 

27 

20 

20 

6 

20 

0 

0 

3 

2« 

.3477 

5 

28 

21 

21 

6 

21 

0 

0 

3 

2< 

•  5583 

6 

29 

34 

34 

6 

34 

0 

0 

3 
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7 

30 

23 

23 

5 

23 

0 

0 

2 
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28 

0 

c 
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2< 
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12 

32 

14 

14 

5 

14 
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0 

2 

2. 
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13 

33 
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15 
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15 
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0 

3 

3< 
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29 

6 

29 

0 

0 

3 

3. 
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9 

35 

19 

19 

5 

19 

0 

0 

2 
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•5207 

14 
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24 
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24 

0 
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3 

3< 
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10 
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6 

25 

c 

0 

3 
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TABLE  36.     TEST  CASE  2  PROGRAM  OUTPUTS,    MODE  2  (CONTINUED) 


UATE       511     ID 
TRADE8FF    F9R 

Pair        i     3 


TTSCAS2A 


C8EFF 


• 

97587 

•  0? 

3<U 

•034?4 

• 

02*56 

NO 

ID 

TY 

CL 

SCRSF 

0   1 

2 

3 

1 

1 

1 

4 

1 

0 

0 

1 

1.6173 

1 

2 

5 

5 

4 

5 

r^ 

p 

1 

1  .6483 

2 

3 
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4 

4 

4 

(j 
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1  .6737 
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4 
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3 

4 

3 
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3 

1 
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5 

6 
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6 

c 

1 
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6 
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4 

16 

c 

0 

1 
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6 

7 
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2 

4 

2 

0 

0 

1 
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7 

8 

10 

10 

4 

10 

c 

0 

1 

1  .7643 

8 

9 

12 

12 

5 

12 

0 

0 

2 

1 .7667 

1 

10 

7 

7 

5 

7 

c 

0 

I  • 

1  .7707 

*•* 
C 

11 

8 

8 

4 

8 

0 

1 «8o48 

9 

12 

13 

13 

5 

13 

c 

0 

2 

1  .8581 

3 

13 

9 

9 

5 

9 

0 

0 

2 

1 .8988 

4 

i* 

18 

18 

5 

18 

0 

0 

2 

1 •9^31 

5 

15 

11 

11 

4 

11 

0 

0 

1 

1.9211 

10 

16 

17 

17 

4 

17 

0 

0 

1 

1 .9*89 

11 

17 

20 

?0 

6 

20 

0 

0 

3 

2*0^57 

1 

18 

22 

22 

5 

22 

0 

0 

2 

2-0484 

6 

19 

15 

15 

6 

15 

c 

0 

3 

2-0635 

2 

20 

27 

27 

4 

27 

c 

0 

1 

2*0680 

12 

i 

21 

1* 

14 

5 

14 

0 

0 

2 
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7 

22 

26 

?6 

5 

26 

r\ 

0 

2 
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8 

23 

31 

31 

5 

31 
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0 

2 
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9 

2* 

32 

32 

5 

32 

c 

0 

2 

2*1619 

to 

25 

23 

23 

5 

23 

c 
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2 

2*1683 

U 

26 

21 

?1 

6 

?1 

0 

0 

3 

2«1971 

3 

27 

28 

28 

5 

28 

0 

0 

2 

2*1993 

12 

28 

35 

35 

5 

35 

0 

0 

2 

2.2101 

13 

29 

30 

30 

6 

30 

c 

c 

3 

2.2135 

4 

30 

19 

19 

5 

15 

0 

0 

2 

2*2343 

14 

31 

38 

38 

6 

38 

0 

0 

3 

2.2381 

5 

32 

39 

39 

6 

35 

0 

0 

3 

2*2438 

6 

33 

29 

?9 
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29 

0 

0 

3 

2*2449 

7 

3* 

2* 

?4 

6 

2* 

0 

0 

3 

2*2^81 
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35 

37 

37 

6 

37 

c 

0 

3 

2*2755 

9 

36 

34 

3* 

6 

34 

c 

3 

2*3302 

i° 

37 

25 

25 

6 

25 

0 

0 

3 

2*4252 

ll 

38 

33 

33 

6 

33 

0 

0 

3 

2*5502 

l"2 

39 

36 

36 

6 

36 

c 

0 

3 

2*5640 

3 
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TABLE  36.     TEST  CASE  2  PROGRAM  OUTPUTS,   MODE  2  (CONCLUDED) 


DATE 

511  ID 

TESC 

AS2 

fli 

TRADEOFF  FQR 

Pair 

2   3 

C8EFF 

-2- 

60272 

-.39808 

•  45C 

N© 

ID 

TY 

1 

39 

39 

6 

39 

0 

2 

38 

38 

6 

38 

0 

3 

16 

16 

4 

16 

0 

4 

18 

18 

5 

18 

c 

5 

35 

35 

5 

35 

c 

6 

12 

12 

5 

12 

0 

7 

32 

32 

5 

32 

0 

8 

27 

?7 

4 

27 

c 

9 

31 

31 

5 

31 

0 

10 

37 

37 

6 

37 

0 

11 

26 

26 

5 

26 

0 

12 

22 

22 

5 

22 

0 

13 

17 

17 

4 

17 

0 

14 

20 

20 

6 

20 

0 

15 

13 

13 

5 

13 

0 

16 

10 

10 

4 

10 

0 

17 

28 

28 

5 

28 

0 

18 

29 

29 

6 

29 

0 

19 

30 

30 

6 

30 

0 

20 

23 

23 

5 

23 

0 

21 

4 

4 

4 

4 

0 

22 

34 

34 

6 

34 

0 

23 

24 

24 

6 

24 

0 

2^ 

8 

8 

4 

8 

0 

25 

11 

11 

4 

11 

0 

26 

3 

3 

4 

3 

o 

27 

15 

15 

6 

15 

c 

28 

5 

5 

4 

5 

0 

29 

7 

7 

5 

7 

0 

30 

6 

6 

4 

6 

0 

31 

9 

9 

5 

9 

c 

32 

21 

21 

6 

21 

0 

33 

36 

36 

6 

36 

0 

34 

14 

14 

5 

14 

0 

35 

2 

2 

4 

2 

0 

36 

1 

1 

4 

1 

0 

37 

19 

19 

5 

19 

0 

38 

25 

25 

6 

25 

0 

39 

33 

33 

6 

33 

0 

• 

6231? 

CL 

SC8RE 

0   1 

2 

3 

0 

3 

-1.9Q86 

1 

0 

3 

-1  .7^56 

2 

0 

1 

-1-2687 

1 

0 

2 

- .4892 

1 

0 

2 

-•3849 

2 

0 

2 

-.31.62 

3 

0 

2 

-•1598 

4 

0 

1 

••0390 

P 

0 

2 

•  1861 

5 

0 

3 

•  3591 

3 

0 

? 

•  7572 

6 

c 

2 

.8093 

7 

o 

1 

1-1031 

3 

3 

1  •1387 

4 

0 

2 

1 «38n4 

8 

0 

1 

1»5o12 

4 

0 

2 

1.9348 

9 

c 

3 

2*0391 

5 

0 

3 

?.7475 

6 

0 

2 

3«l?91 

10 

c 

1 

3.2665 

5 

c 

3 

3»4??8 

7 

0 

3 

3*6836 

8 

0 

1 

3*7523 

6 

0 

1 

3»9418 

7 

0 

1 

4*0626 

8 

0 

3 

4*0817 

9 

0 

1 

4.2878  ' 

9 

\J 

2 

4.7901 

U 

0 

1 

4.8423 

10 

n 

2 

5.H95 

12 

0 

3 

5.2402 

10 

0 

3 

5*2593 

U 

0 

2 

5.3967 

13 

0 

1 

5.4820 

11 

0 

1 

5.4820 

12 

0 

2 

5.8469 

14 

0 

3 

7.2496 

1* 

0 

3 

7.4P26 

13 
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TABLE  37.     LOGICAL  MODE  OUTPUTS  FOR  TEST  CASE  2 


r*TE   518  ID  TTSCAS 
LC9U" T  .  6 


-2  3»6 

-6  P 

-»  C 

3  3»1H»J»»13 

k    6»0»0.r»l»2.3 

5  6»1»2,3,»,5.6 

2  lilC0r>C»-3»l8Sl3« 

•17l?6» 

•'9953. 
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2  J«lcOr.(  ,-i'»2525» 

.rfc77]. 
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?  3'1C0'C'-!'T3m61. 
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."•734, 

. 0*697 
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f L*G( 1 1 
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( 
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3 
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•  9 

3^5 

type  i 

?  3 

**  5 

6 

Clas  o 

:  o 

1  ? 

5 
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3   » 

T 

(• 
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NS 

10 

TV 

NF 

CL 

1 

2 

3 

fa 

5 

6 

7 

a 

9 

]3 
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1 

* 

3 

1 

0 
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3 

it 
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0 

0 

c 

0 

3 

:> 

P 

k 

3 

?    0 

0 

■   0 

-, 

0 

5 

3 

1<. 

0 

o 

o 

o 

3 

0 

o 

3 

3 

k 

3 

3 

0 

.  c 

3 

3 

5 

k 

11 

0 

o 

o 

3 

0 

0 

3 

* 

it 

It 

3 
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0 
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3 

c. 

5 

5 

9 

0 
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3 

0 
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3 

5 

5 
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3 
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0 
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0 

k 

c 
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o 
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7 
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7 

0 
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10 

0 

o 
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o 

0 

0 

o 

5 
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3 

r 

0 
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3 

r 

5 

13 

k 

0 

0 
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0 

o 

o 

o 
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9 
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9 

0 
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3 

j 
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9 
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10 

1C 
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3 
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0 
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12 

? 
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1? 

J 

►   " 
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3 

a 

■j 
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0 

3 

o 

o 

c 

O 

13 

13 

E 

3 

13    ) 

0 

.   C 

- 

- 

a 

3 

c 

0 

0 

- 

J 

0 

0 

3 

1* 

l<t 

5 

3 

1»   r 

c 

.  r 

- 

0 

3 

11 

10 

c 

3 

o 

J 

0 

c 

3 

15 

15 

6 

3 
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0 

r 

r 

0 

H 

15 

5 

o 

0 

£ 

3 

c 

o 

3 

16 

16 

4 

3 

If-    ~ 

c 

- 

o 

3 

b 

5 

2 

0 

3 

3 

0 

c 

3 

17 

17 

<• 

3 

17 

0 

r 

r- 

- 

10 

6 

8 

c 

o 

3 

3 

o 

o 

0 

18 

13 

F 

3 

IK      1 

3 

z 

o 

10 

a 

i. 

n 

3 

3 

0 

o 

c 

3 

13 

19 

F 

3 

lc 

0   . 

- 

1 

10 

U 

12 

o 

3 

3 

0 

0 

c 

3 

2: 

?c 

6 

3 

20 

0 

n 

" 

10 

13 

9 

o 

~ 

3 

0 

r. 

o 

3 

21 

21 

f 

3 

2l 

0 

z 

- 

T 

11 

5 

16 

3 

3 

- 

0 

c 

3 

2? 

'2 

c; 

3 

2?    - 

0 

3 

? 

* 

11 

3 

6 

C 

3, 

i 

3 

3 

23 

23 

& 

3 

23 

c 

3 

•> 

.1 

11 

1 

9 

•1 

,3 

J 

c 

3 

3 

?» 

2* 

6 

3 

24 

0   . 

3 

c 

3 

11 

1" 

7 

r 

1 

« 

3 

o 

C 

3 

25 

35 
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3 

2- 

o 
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3 

" 

11 

15 

12 

0 

O 

o 

c 

o 

3 

26 

?6 

c 

3 

26 

0 

0 

3 

-1 

1? 

7 

a 

3 

o 

o 

3 

o 

0 

3 

27 

'7 

if 

3 

27    j 
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0 

-. 

3 

12 

a 

6 

0 

0 

o 

3 

c 

3 

28 

28 

c 

3 

2k 

c   . 

3 

r 

3. 

12 

11 

7 

»- 

J 

0 

3 

0 

t; 

3 

23 

?9 

6 

3 

2  = 

c  . 

0 

i 

3 

12 

1» 

5 

0 

o 

0 

o 

0 

0 

33 

3~ 

h 

3 

3- 

0   . 

~ 

o 

- 

13 

4 

it 

2 

o 

"3 

3 

0 

3 

3 

31 

31 

*• 

? 

3] 

9  ■ 

3 

0 

' 

13 

a 

7 

3 

1 

3 

3 

0 

c 

3 
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TABLE  37.     LOGICAL  MODE  OUTPUTS  FOR  TEST  CASE  2  (CONTINUED) 


32 

3? 

c 

3 

32 

0 

,   Q 

- 

0 

13 

10 

5 
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0 
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0 

0 

0 

33 

33 

6 

3 

33 

0 

t   0 

7 

7 

13 

13 

15 

0 
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0 

0 

0 

0 

0 

3* 

3»' 
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3 

3a 

z 

c 
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z 

0 

14 

R 

15 

0 

0 

0 

0 
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0 

0 

35 

35 

r 
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35 

', 

0 

.   C 

3 

- 

1A 

9 

6 

0 

0 

0 

0 

0 

0 

0 

36 

36 

6 

3 

36 

7 

0 

.  c 

-) 

7 

1A 

16 

10 

7. 

0 

0 

3 

0 

0 

0 

37 

37 

6 

3 

37 

- 

0 

»   0 

r 

7 

15 

6 

10 

0 

0 

0 

0 

0 

0 

0 

38 

38 

6 

3 

38 

- 

0 

»  c 

7 

0 

16 

5 

8 

0 

0 

0 

0 

0 

0 

0 

39 

39 

6 

3 

39 

0 

>  c 

0 

7 

16 

6 

7 

c 

0 

0 

0 

0 

c 

0 

C6E* 
<T 

i: 

hcieni 
<p      c 

COO  -3. 
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•171  3 

.9953E- 

-! 

.6738ET.1 

•C000 
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2: 
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•li 
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6771E--, 

.9 

7aE- 

71 

•21O3E-01 

•  0000 

•0000 

000" 

3- 

000 

•1. 

9c5 

B414E". 

•  4 

786E- 

71 

•  t 

698E-C1 

•  000: 

•COCO 

coor 

»r 

000 

-1  • 

1-3 

5392E- 

.3 

•  24E- 

-1 

•: 

856E-71 

•ooco 

•0000 

0007 

5c 

000 

•1. 

228 

5392E- 

•  3 

•  24E- 

-,1 

•'856E-31 

•0000 

•CCJO 

0007 

6; 

ooo 

-«■ 

885 

9820E-r 

.3 

)^5 

•  1 

Qqj 

•0C00 

•OOCO 

CCOO 

feature 

«C1 

">RS 

NO 

ID 

TY 

vr 

CL 

1 

p 

3 

A 

5 

6 

7 

8 

9 

1  3 

l 

1 

A 

3 

1 

7, 

0 

i   0 

z 

-14677 

-6c26 

-R977 

-46,1 

•5866 

•9631 

0 

0 

0 

'0 

P 

2 

4 

3 

2 

7 

0 

,  o 

- 

0 

•17900 

-5169 

-6827 

-33-4 

•A559 

-6780 

c 

0 

0 

0 

3 

3 

A 

3 

3 

7 

0 

.   0 

7 

7 

•11926 

-488? 

-7758 

-38,9 

-5n7A 

•9658 

0 

c 

0 

7 

It 

4 

A 

3 

A 

0 

0 

i   c 

7 

7 

•1227S 

-4385 

-8218 

-aCa7 

-5302 

-105A5 

0 

0 

0 

0 

5 

5 

A 

3 

K 

r 

0 

i   c 

- 

c 

-13317 

-4852 

.859-. 

-43-1 

-5=56 

-y536 

0 

0 

0 

0 

6 

6 

A 

3 

6 

7 

0 

t   ^ 

7 

-1-684 

-161,2 

-7615 

-35  3 

-A758 

-113» 

0 

0 

0 

3 

7 

7 

? 

3 

7 

3 

0 

,   c 

3 

7 

-0614 

-23A; 

-6731 

-3077 

•4332 

-S36A 

c 

c 

0 

0 

8 

8 

A 

3 

8 

3 

0 

,   fi 

7 

7 

-7685 

1903 

-6738 

-?7,6 

•3991 

4258 

0 

0 

0 

0 

9 

9 

C 

3 

9 

r 

0 

»   0 

- 

0 

•  5589 

879 

-A9SA 

-;7q6 

-3-51 

S911 

0 

7 

0 

0 

10 

10 

A 

3 

1; 

-> 

0 

.  c 

7 

0 

-RR84 

-1827 

-6°88 

-3'.  Al 

-4396 

-«J65 

0 

0 

0 

3 

11 

11 

A 

3 

U 

c 

0 

►   Q 

i 

n 

•5119 

-1723 

-A?85 

-  573 

-2o28 

-1626 

0 

0 

c 

0 

12 

12 

? 

3 

12 

- 

0 

i   r 

0 

3 

-8197 

-863 

-7-77 

-31l7 

-A37? 

-1C261 

0 

C 

0 

0 

13 

13 

c 

3 

1? 

- 

0 

.   0 

- 

7, 

-SR54 

A7A 

-5659 

-2?  3 

"3a5» 

-  J1BA 

- 

C 

0 

c 

1* 

1" 

R 

3 

14 

0 

0 

,   j 

3 

-A95 

336i 

-2353 

•90 

•  1345 

12961 

0 

0 

c 

0 

15 

15 

6 

3 

15 

•> 

3 

.  c 

- 

3 

116 

5983 

-2787 

•  1.9 

•lAOA 

15385 

0 

0 

0 

0 

16 

1* 

A 

3 

16 

3 

0 

,   3 

-aU8 

-3A36 

-7211 

-3376 

•A631 

-17677 

0 

3 

c 

7 

17 

17 

A 

3 

17 

0 

0 

»   0 

0 

7 

-3393 

-293 

-*CC3 

-l?g5 

-2K5- 

•4532 

0 

0 

0 

0 

18 

18 

5 

3 

18 

3 

0  ' 

.   0 

7 

0 

-4098 

70C 

-4925 

-1753 

•3n08 

-6306 

0 

0 

c 

0 

19 

19 

c 

3 

19 

7 

0 

,   c 

7 

c 

4276 

5136 

268 

l5*,8 

303 

189-7 

3 

c 

0 

G 

20 

?0 

6 

3 

2- 

7 

0 

i  c 

- 

0 

?C3 

507S 

-3roi 

-3j6 

-15»1 

?177 

0 

0 

c 

0 

21 

21 

6 

3 

21 

o 

0 

,   3 

7 

Q 

2712 

11»8 

116 

l!f5 

.69 

9283 

0 

0 

0 

0 

22 

22 

5 

3 

22 

0 

0 

,  c 

- 

7 

-A3 

2716 

-2665 

-3-C 

•15b5 

i752 

0 

0 

0 

0 

23 

23 

5 

3 

23 

o 

0 

o 

0 

2973 

4264 

-778 

"198 

-3b6 

10820 

0 

0 

c 

0 

24 

24 

6 

3 

2a 

- 

0 

.   0 

7 

-. 

*6G6 

7514 

196 

16«7 

aA2 

19218 

0 

0 

0 

0 

25 

25 

6 

3 

25 

7 

0 

,   - 

0 

9073 

9483 

302A 

3*67 

2212 

32269 

0 

c 

0 

0 

26 

?6 

5 

3 

26 

- 

0 

,       - 

7 

- 

1  326 

1978 

-18A2 

1?" 

•U30 

526 

0 

0 

u 

0 

27 

27 

A 

3 

27 

£ 

0 

o 

7 

3 

674 

2475 

-2303 

-1  3 

■1358 

•3*0 

0 

0 

0 

0 

28 

28 

c 

3 

28 

7 

0 

z 

3 

7 

4333 

5438 

-397 

l2_-8 

.46 

10915 

0 

0 

3 

0 

29 

29 

6 

3 

2S 

- 

0 

, 

- 

7 

5971 

777! 

98 

l6fc» 

409 

16218 

0 

0 

c 

0 

30 

3C 

6 

3 

3; 

; 

0 

,   o 

7 

7 

3795 

1164 

381 

1350 

95 

4170 

0 

0 

0 

0 

31 

31 

5 

3 

31 

C 

0 

3 

7 

0 

''Cfro 

3363 

-991 

720 

-n3* 

2612 

- 

0 

0 

3 

32 

32 

c 

3 

32 

0 

►   r 

7 

7 

37C3 

47  77 

-97A 

R-aA 

-420 

4823  ' 

0 

c 

0 

0 

33 

33 

6 

3 

33 

r 

0 

i   0 

7, 

0 

13A26 

9633 

5158 

A7]7 

3462 

34Q16 

0 

0 

0 

3 

34 

3» 

6 

3 

34 

- 

0 

0 

.7 

7 

7177 

2969 

2171 

2517 

1262 

1C238 

0 

0 

0 

0 

35 

35 

R 

3 

3? 

0 

0 

»   0 

7 

7 

579A 

A7A7 

-1»1 

I3j6 

61 

4698 

0 

0 

0 

0 

36 

36 

6 

3 

36 

0 

0 

7 

C 

- 

1A755 

12GH 

5087 

A8t,5 

3600 

3A3?7 

0 

0 

c 

0 

37 

37 

6 

3 

37 

0 

7 

-, 

n 

6516 

3513 

11A2 

1971 

716 

4359 

0 

0 

0 

3 

38 

38 

6 

3 

3? 

0  . 

r 

7 

n 

5886 

283] 

565 

!5?6 

3*1 

•1735 

3 

0 

0 

0 

39 

39 

6 

3 

39 

c  ■ 

0 

7 

0 

6207 

3559 

574 

1*53 

398 

-631 

0 

0 

0 

0 

?»EP 

^ELECTED 

SAf 

PLES 

CLASS 

0 

) 

? 

J     A 

^   t 

7 

8 

9   17 

■-U"Bt'* 

0 

1? 

1 

A    1 

3 

NSS    »    39 


150 


TABLE  37.     LOGICAL  MODE  OUTPUTS  FOR  TEST  CASE  2  (CONCLUDED) 
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THE  KARNAUGH  MAP  METHOD 

Karnaugh  mapping  is  a  graphic  procedure  which  assigns  a  map  region  to 
each  logical  variable.     In  one  half  of  this  region  the  logical  variable  is  true, 
in  the  other  half  it  is  false.     Within  each  half,   additional  regions  may  be 
defined  for  additional  variables,  which  themselves  have  a  true  half  and  a  false 
half.     The  two- variable  example  in  Figure  17a  will  illustrate  this.     In  the  top 
half  of  the  map,   variable  B  is  true,  while  in  the  bottom  half  it  is  false.     Vari- 
able A  is  true  on  the  left  half  of  the  map,   and  false  on  the  right  half.     Four 
"states"  are  thus  defined:  (A  true,    B  true),    (A  true,   B  false),    (A  false,   B 
true),  A  false,   B  false).     States  may  be  combined  as  follows:  to  combine  the 
two  states  (A  true,    B  false)  and  (A  false,    B  false)  variable  A  may  be  ignored; 
the  combination  of  the  above  two  states  may  be  called  (B  false),   since  it  is 
defined  for  any  A  (true  or  false)  when  B  is  false.     Note  that  the  two  states  to 
be  combined  share  a  boundary.     To  combine  two  states,  either    A  or  B  should 
be  the  same  in  both  states.    Thus,  these  two  states  I  (A  true,   B  false)  and  (A 
false,  B  true)    may  not  be  combined,   for  this  map.     (Note  that  these  two  states 
do  not  share  any  boundaries.  )    A  Karnaugh  map  of  three  logical  variables  is 
shown  in  Figure  17b.    There  are  eight  states  in  this  map;  if  true  is  repre- 
sented by  the  value  one  and  false  by  value  zero,  the  eight  possible  states  are: 

A  B      C 


0 

0 

0 

0 

0 

1 

0 

1 

0 

0 

1 

1 

1 

0 

0 

1 

0 

1 

1 

1 

0 

1 

1 

1 

Note  that  each  logical  variable  is  true  in  half  the  states,  and  false  in  the  other 
half.     On  the  actual  Karnaugh  map,  the  false  states  of  variable  C  are  split  to 
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prevent  C  from  always  being  the  same  as  A,   or  always  the  opposite  of  A,    since 
this  would  be  the  same  as  a  two-variable  situation.     States  may  be  combined 
as  with  two  variables;  combining  states  (A  true,    B  false,  C  false)  and  (A  false, 
B  false,  C  false)  gives  the  result  (B  false,   C  false)  for  any  A. 

Note  that  this  combined  state  is  possible  because  of  the  shared  boundary  of 
the  two  (C  false)  regions;  that  is,  the  map  maybe  thought  of  as  being  continu- 
ous by  joining  the  ends  or  the  top  and  bottom.     The  boundary  at  the  left  edge 
of  the  map  is  the  same  boundary  as  that  at  the  right  edge,   and  the  boundary 
at  the  top  is  the  same  boundary  as  at  the  bottom. 

Combined  states  maybe  further  combined;  again  the  requirement  is  for  a  com- 
mon boundary  or  unchanging  variable.     For  example,   state  (A  true,    B  true, 
C  false)  and  state  (A  true,   B  false,  C  false)  may  be  combined  to  (A  true,  C 
false).     Similarly,    state  (A  true,    B  true,  C  true)  and  state  (A  true,    B  false, 
C  true)  combine  to  form  state  (A  true,  C  true).     Now  the  two  combined  states 
may  be  joined  to  form  the  state  (A  true)  for  all  B  and  C.     (Note  this  state  (A 
true),   with  only  one  variable  defined,   comprises  half  of  the  Karnaugh  map  of 
Figure  17b.  ) 

The  utility  of  combining  states  comes  from  reducing  the  number  of  variables 
which  must  be  specified  to  determine  the  desired  state.     In  the  classifier  pro- 
gram, the  result  of  the  logical  method  using  six  variables  was  a  list  of  10 
states  (out  of  a  possible  64),   with  the  three  classes  spread  through  them. 
Combining  states  with  Karnaugh  mapping  techniques  may  allow  specifying  a 
single  class  made  up  of  several  states  without  using  all  six  variables.     The 
Karnaugh  map  of  the  method  three  (logical  mode)  results  is  shown  in  Figure 
18. 

Many  of  the  states  on  the  map  have  no  feature  vectors  in  them,    since  only  ten 
distinct  groups  were  formed  by  the  logical  mode  classifier.     These  empty 
states  may  be  used  to  produce  combined  states,    since  they  contain  no  values, 
and  might  produce  a  simpler  expression  by  eliminating  one  or  more  of  the 
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Figure  17.     Karnaugh  Map  Example 
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six  variables.     For  example,   any  feature  vector  which  has  all  of  its  variables 
false  will  be  in  the  region  of  the  map  (000000).      However,   since  the  adjacent 
column  is  empty,  the  variable  C  may  be  ignored;  the  region  then  may  be  de- 
fined as   (00X000),     where  X  means  a  "don't  care"  variable.     This  combining 

does  not  introduce  any  undesired  feature  vectors,   nor  does  it  leave  out  any 
desired  vectors.     Further,   variables  d,   e,   and  f  may  all  be  ignored,   thus  the 
combined  region  is  (A  false,   B  false),   or  OOXXXX    (X  =  don't  care),   for  any 
c,   d,   e,   f  values.     Further  combining  to  determine  presence  of  this  state  is 
B;  any  feature  vector  which  has  (B  false)  is  in  this  region,    regardless  of  the 
states  of  any  other  variables. 

The  combinations  described  here  are  not  the  only  ones  that  are  available. 
Different  combinations  may  be  formed,   as  required,  to  include  different  states 
of  the  Karnaugh  map.     These  states  are  identified  in  terms  of  the  six  logical 
variables  by  assigning  value  one  to  a  true  variable  and  value  zero  to  a  false 
variable.     Thus,   the  state  (A  true,   B  true,   C  true,   D  true,  E  true,   F  false) 
may  be  represented  as  state  111110.      This  is  one  state  of  the  possible  64 
in  a  six-variable  Karnaugh  map.    State  (A  true,    B  false,   C  false,   D  true,   E 
false,   F  true)  would  be  represented  as  100101.      By  using  the  Karnaugh  map, 
the  original  three  classes  may  be  defined  in  terms  of  the  states  which  contain 
vectors  of  each  class,   and,  because  of  the  many  empty  states  ("don't  care" 
states  which  neither  contribute  nor  eliminate  feature  vectors),  the  expres- 
sion for  a  given  class  will  probably  not  need  to  include  all  six  of  the  logical 
variables.     In  the  Karnaugh  map  for  the  logical  mode  classification  of  test 
case  two,  the  classes  may  be  identified  by  variable  values  as  follows:  class 

1  is  l(B  false)  or  (A  true,   E  false,   F  false)],   or  equivalently,   any  state  X0X 
XXX  or  1XXX00    is  a  member  of  the  group  of  states  comprising  class  1;  class 

2  is  all  states  01XXXX     or   XX01XX  ;  class  3  is  XX1XXX     or  1XX0X1. 
Although  each  of  the  six  variables  is  used  at  least  once  in  all  these  terms,   no 
term  uses  all  six,  therefore  class  determination  is  simplified  in  terms  of  the 
number  of  variables  needing  to  be  specified.     This  grouping  includes  four  mis- 
classified  vectors;  this  misclassification  occurs  when  a  single  state  contains 
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vectors  from  more  than  one  class,    such  as  state  000000    which  contains 
mostly  class  1  feature  vectors.     If  state    000000    is  called  a  class  1  state,  the 
two  vectors  in  state    000000    from  class  2  will  be  misclassified;  state    010001 
contains  vectors  from  two  different  classes,  as  does  state  111111.      This 
mixing  of  classes  within  a  single  state  results  from  the  selection  of  pairwise 
boundaries,   and  is  analogous  to  misclassified  feature  vectors  found  in  method 
1  or  method  2  executions. 

A  simplification  of  the  class  determination  from  the  logical  mode  results  may 
be  obtained  at  the  expense  of  additional  misclassified  feature  vectors.     For 
test  case  2,  these  additionally  misclassified  vectors  are  those  in  states 
110,  000  and  110,  001.     If  these  two  states  are  made  part  of  class  2,  the  deter- 
mination of  classes  becomes: 

Class  1  for  all  (B  false),   states  X0XXXX 

Class  2  for  all  (B  true,  C  false),   states  X10XXX 

Class  3  for  all  (A  true,  C  true),    states    1XXXX. 

(Note  that  variables  D,  E,  and  F  maybe  ignored  completely  in  this  determina- 
tion,  however,  there  are  now  seven  misclassified  feature  vectors  instead  of 
four. ) 

The  data  set  was  projected  onto  a  subspace  by  using  a  "minus  eight"  card 
along  with  a  pair  of  "two"  cards.     The  second  field  of  the  "minus  eight"  card 
was  punched  with  the  value  1  for  the  subspace  projection;  the  subspace  to  be 
used  was  defined  using  the  "two"  cards.     Since,   in  three  dimensions,   a  plane 
is  defined  by  any  three  points,  the  spanning  set  of  vectors  to  define  the  plane 
was  chosen  as  two  of  the  vectors  representing  the  differences  between  the 
class  means.     One  of  these  vectors  was  found  by  subtracting  each  component 
of  the  mean  vector  of  class  1  from  the  corresponding  component  of  the  mean 
vector  of  class  3;  the  other  vector  was  similarly  found  by  subtracting  each 
component  of  the  mean  vector  of  class  2  from  the  mean  vector  of  class  3,   as 
shown  here : 
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Class  1  mean  vector: 


Class  2  mean  vector: 


Class  3  mean  vector: 


Spanning  vector  A  (3-2): 


Spanning  vector  B  (3-1) 


6.417  in  feature  1  direction 

6.  083  in  feature  2  direction 

8.  750  in  feature  3  direction 

10.  070  in  feature  1  direction 

9.  143  in  feature  2  direction 

7.  214  in  feature  3  direction 

12.  620  in  feature  1  direction 

10.  080  in  feature  2  direction 
9.  7  69  in  feature  3  direction 

2.  550  in  feature  1  direction 

0.  937  in  feature  2  direction 

2.  555  in  feature  3  direction 

6.  203  in  feature  1  direction 

3.  997  in  feature  2  direction 

1.  019  in  feature  3  direction 


These  spanning  vectors  are  input  to  the  program  using  coefficient  cards 
("two"  cards),   one  for  each  spanning  vector;  the  second  and  fourth  fields  of 
these  "two"  cards  are  not  used  by  the  program  and  may  contain  any  value, 
however,  the  scaling  factor  (third  field)  is  required.     The  data  set  is  then  pro- 
jected onto  the  plane  defined  by  the  two  spanning  vectors  (two  vectors  having 
a  common  origin  define  a  plane),   or  onto  its  orthogonal  complement  (a  line 
for  this  case),  depending  upon  the  value  in  the  second  field  of  the  "minus 
eight"  card.     This  projection  produces  new  feature  values  for  each  feature 
vector;  the  program  then  executes  using  this  re-defined  feature  vector  set. 

A  subspace  of  a  three-dimensional  space  may  be  either  a  two-dimensional 
space  (plane),  or  a  one -dimensional  space  (line).  The  orthogonal  comple- 
ment (in  the  three-dimensional  case)  of  the  two-dimensional  subspace  (plane) 
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is  the  normal  line  to  that  plane,   and  conversely.     For  a  four-dimensional 
space,   a  subspace  could  be  of  three  dimensions,    or  of  two  dimensions,   or  of 
one  dimension;  the  orthogonal  complement  to  these  would  be  of  one,  two,    or 
three  dimensions,    respectively.     By  projecting  a  data  set  onto  a  subspace, 
all  variations  in  the  direction  orthogonal  to  the  subspace  is  eliminated,    sim- 
plifying the  data  representation  and  possibly  permitting  a  simpler  solution  to 
the  classification  problem. 

Table  38  shows  the  results  of  projecting  the  test  case  2  data  onto  the  plane  of 
the  means  of  the  three  classes.     Since  this  plane  is  in  a  three-dimensional 
space,  three  coordinates  are  needed  to  specify  any  point,   and  that  is  the  rea- 
son for  there  being  three  coordinates  for  points  in  the  two-dimensional 
space. 

To  plot  this  data  on    a  two-dimensional  surface,   any  two  of  the  projected  co- 
ordinates can  be  used.     Figure  19  shows  the  data  plotted  using  projected  fea- 
tures 1  and  2.     This  plot  can  be  compared  with  Table  27  to  see  the  effect  of 
the  third  feature  upon  the  data  distribution.     (The  points  in  both  figures  have 
been  connected  together  in  the  same  way  by  lines.     Comparing  the  shapes  thus 
outlined  will  give  an  idea  of  how  the  third  feature  warped  the  distributions.  ) 
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CHAPTER  5 
PROGRAM  STRUCTURE 


The  program  is  comprised  of  a  main  program  block  and  10  subroutines;  five 
additional  library  subroutines  are  called  during  program  execution.     The  main 
program  block  performs  the  functions  of  data  and  control  card  input,  data  pre- 
paration,  statistical  calculation,   classification,  and  output  listing.     Eight  of 
the  subroutines  perform  matrix  and  vector  arithmetic  such  as  dot  products, 
cross  products,   addition,   multiplication  by  a  scalar;  one  subroutine  evaluates 
eigenvalues;    and  one  is  used  to  calculate  and  print  tradeoff  data  based  on  fea- 
ture values  or  feature  vector  scores.     One  of  the  library  subroutines  performs 
matrix  inversion;  the  others  used  by  the  program  file  manipulations  such  as 
reading  and  writing. 

The  main  program  functions  are  structured  as  modules  of  code  within  the  main 
program,  and  are  jumped  to  by  the  main  control  loop.    When  one  of  these  mo- 
dules is  "entered"  by  the  program,   it  performs  its  function  based  on  status 
flags  which  are  set  or  cleared  by  other  modules.     When  the  function  of  a  par- 
ticular module  is  complete,   a  jump  is  made  back  to  the  main  control  loop. 
This  main  control  loop  is  an  infinite  loop,   and  contains  programmed  pauses 
to  allow  the  operator  to  input  data  or  otherwise  control  program  execution. 
Use  of  this  infinite  loop  is  permitted  by  the  system  monitor,    since  control 
is  returned  to  the  monitor  when  an  execution  is  complete  and  no  data  remains 
to  be  input. 

There  are  three  programmed  pauses  in  the  program;  each  has  a  number  which 
is  printed  on  the  typewriter  input /output  device  whenever  the  pause  is  en- 
countered by  the  program.     The  program  also  tests  two  console  switches, 
called  sense  switch  one  and  sense  switch  six.     If  sense  switch  one  is  on,  the 
program  will  enable  the  typewriter  for  data  input  or  modification  prior  to 
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execution;  if  sense  switch  six  is  on,  the  program  will  suppress  the  feature 
vector  listing  on  the  output.     Sense  switches  should  be  set  before  starting  the 
program  run. 

Programmed  pause  number  1  occurs  upon  completion  of  an  execution,   and 
allows  the  operator  to  change  magnetic  tapes,   set  switches,   or  load  the  next 
set  of  cards  into  the  card  reader  before  proceeding.     To  continue  the  run,   a 
carriage  return  should  be  typed  by  the  operator.     Pause  2  occurs  when  the 
program  detects  an  error  in  the  input  cards;  if  either  the  number  of  classes 
(field  two  of  "three"  card),   number  of  types  (field  two  of  "four"  card),   or 
number  of  features  (field  two  of  "five"  card)  is  zero,  the  program  will  exe- 
cute a  pause  2.     At  that  time,  the  operator  may  continue  the  run  by  typing 
a  carriage  return,   in  which  case  errors  in  output  will  result;   or  sense  switch 
1  may  be  turned  on,   followed  by  a  carriage  return,   in  which  case  the  pro- 
gram will  accept  new  or  revised  data  from  the  typewriter  input  device.     This 
new  or  revised  data  must  follow  a  specified  format  to  ensure  program  recogni- 
tion.    An  example  of  the  required  format  is:    "NC  =  3".     This  means  "the 
variable  named  NC  should  be  set  to  the  value  3".     (The  quote  marks  are  not 
part  of  the  format;  they  are  used  here  to  delimit  the  format  required  charac- 
ters. )    Following  a  statement  such  as  "NC  =  3,  "  a  carriage  return  is  typed, 
and  another  data  value  may  be  input,    such  as  "NT  =  6,  "  followed  by  a  car- 
riage return,   followed  by  as  many  new  or  revised  data  vlues  as  desired,   in 
the  specified  format,   each  followed  by  a  carriage  return.     To  terminate  this 
input  operation,  type  an  upper  case  Q,  then  carriage  return.     Pause  3  occurs 
when  the  program  detects  that  no  samples  (feature  vectors)  have  been  selected 
for  classification.     This  would  occur  if  no  class  were  specified  for  any  of  the 
feature  vector  types  being  used  in  the  current  execution  (see  "four"  card  dis- 
cussion). 
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FIELD  DELIMITERS 

Most  cards  used  by  the  program  have  a  format  with  the  first  field  specified 
as  three  card  columns  wide  and  other  fields  on  the  card  being  defined  as 
"widthless"  or  free  format.     This  means  the  fields  are  set  off  from  each  other 
by  certain  characters,  called  delimiters,   rather  than  by  being  a  certain  num- 
ber of  columns  in  width.    Comma  characters  and  blank  characters  (space 
characters)  are  commonly  used  as  delimiters.     Any  comma  is  read  as  a  de- 
limiter, but  the  only  spaces  (blanks)  which  are  read  as  delimiters  are  those 
which  are  preceded  by  a  digit  (0-9)  or  decimal  point.  Other  blanks  are  ignored, 
and  empty  fields  are  read  as  zeros. 
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TABLE  39.  TABLE  OF  VARIABLES  AND  ARRAYS 

ACCESSIBLE  TO  THE  PROGRAM  WRITER 
THROUGH  THE  USE  OF  CONTROL  CARDS 
AND  DATA  CARDS 


Name 

Use  Immediately  Prior  to  Execute  (-99) 

CLASS  (I) 

Class  to  which  type  I  is  assigned 

FEAT  (1:20,    I) 

Feature  vector  data  for  I      feature  vector  sample: 

FEAT  (1,    I)  =  I 

FEAT  (2,    I)  =  sample  i.d.   number 

FEAT  (3,    I)  =  sample  type 

FEAT  (4,    I)  =  number  of  features  in  sample 

FEAT  (5,   I) 

FEAT  (7,   I) )  -  0  to  suppress    |   in  the  case 
1  /  0  to  transform  f   MODE  2^0 

FEAT  (11:20,   I)  =  feature  vector 

FLAG  (1) 

Number  of  feature  vector  cards  read  since  last  execute 

FLAG  (3) 

Number  of  coefficient  vector  cards  since  last  execute 

FLAG  (4) 

Number  of  feature  tradeoff  listings  (=  number  of  -7  cards 
since  last  execute) 

ITV  (I) 

Feature  #to  be  defined  by  the  I      coefficient  vector 

ITV  (10  +  I) 

Scaling  factor  for  feature  defined  by  the  I       coefficient  vector 

KMODE 

KMODE  =  1  for  method  1  classifier 

KMODE  =  2  for  method  2  classifier 

KMODE  =  3  for  method  3  classifier  (logical  mode) 

KMCOH  -   0  for  no  classification  (default  value) 

LCOUNT 

Number  of  features  to  be  used  by  logical  mode 

LIST  (I) 

LIST  (I)  ^0  for  I      list  option.     Only  options  5,    6,   and  7  implemented 

MODE  2 

MODE  2  =  1  for  secondary  feature  transformation  1 

MODE  2  =  2  for  secondary  feature  transformation  2 

MODE  0  =  for  no  secondary  feature  transformations  (default  value) 

NC 

Number  of  Classes 

NF 

Number  of  Features  to  be  used  during  execution 

NFV 

Number  of  Feature  Vectors  to  be  used  in  execution 

NPCON 

NPCON  =  1  for  projection  to  subspace 

NPCON  =  2  for  projection  to  complement 

NPCON  =  0  for  no  projection  (default  value) 

NT 

Number  of  Types 

PROB  (I) 

Probability  for  class  I 

SFEAT  (I) 

I      selected  feature 

TM1  (1:10,   I) 

I      coefficient  vector 

TV1  (I) 

Constant  for  feature  defined  by  the  I      coefficient  vector 
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Figure  20.     Flow  Charts  (Continued) 
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-2 


Q2F) 


DATA  CARD 
CONTAINS 
CLASSIFIER  MODE 
INFORMATION 


c  380  y 


DECODE  INCARD  (1),(2) 

INTO  KMODE,  LCOUNT 

USING 

2301  FORMAT  (  161) 

OUTPUT  LCOUNT  TO  LP 


DATA  CARD 
CONTAINS 
LISTING  OPTIONS 


DECODE  INCARD  INTO 
LIST(11^20)  USING 
2305  FORMAT  (1016) 


NO 


FOR  1=11,20 

J  ^LIST  CI) 

AND 

IF  (J)  382,388,384 


YES 


LIST(-J)*"0 


LISTUn 


4 * «- 
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(  390   ) 


RESTORE  SAVED 
DATA  BEHIND 
NEW  DATA 


-99 
Q  400   ) 


DATA  CARD 
FUGS  BEGIN 
I    EXECUTION 


OUTPUT  ON  LP 
EXECUTE', 
FLAG(l) 


OUTPUT  ON  LP 
DATA  RESTORED 


YES 


FOR  l=l,NSAV 
FEAT(I,1)-SAVE(I);  AND 
NFV  "NSAV/20 


SUPPRESS  BY 
SSI  OFF 


FOR  1=1, NSAV 
FEAT(20*NFV+I,1)~ 

SAVE(I) 
AND 
NFU-NFV+NSAV/20 


T 
NSAV= 
20*(#0F 
FEATURE 
VECTORS 
TO  SAVE) 


PROG.  VARIABLES  ARE 


YES 


OUTPUT  TY 
'ERROR', NC, NT 
NF 


TY  INPUT  FOR 
PARAMETER  VALUE 
SETTING,  ALL  NAMES 
IN  NAMELIST(BLANK) 
HENCE  ALL  VAR.INPROG 


DATA  SUMMARY 
OUTPUT  ON  LP; 
NFV^^N^NF^MODE 
PROBd-  NC),CLAS(1^NT) 
SFEAT(1~NF) 


NFV 

NC 

NT 

NF 

KMODE 

NDT 
NCT 
NPCON 
M0DE2 

MODE 
LCOUNT 

FLAG  USAGE 

FLAG  (1): 


FLAG  (2) 
CLAG  (3) 
FLAG  (4) 
FLAG  (5) 


NUMBER  OF  FEATURE  VECTORS 
NUMBER  OF  CLASSES 
NUMBER  OF  TYPES 
NUMBER  OF  FEATURES 
CLASSIFIER  SELECT  FLAG 


PROJECTION  FLAG 

BUS  DETECTOR  FEATURE  FLAG:  SECONDARY 

OR  PRIMARY 

SEE  TRADEOFF 

WHEN  KM0DE=3,  LCOUNT  =  *  FEATURES  IN  VECTOR 


COUNT  ON  NFV  FOR  BUS  DETECTOR  FEATURES 

OR 
OTHER  FEATURE  NFV  (310,  3100,  3150) 
UNUSED 

COUNT  OF  COEFFICIENT  VECTORS  (320) 
COUNT  OF  TRADEOFF  LISTINGS  (470) 
FLAGS  FEATURES  TYPE  REASSIGNMENT  (490) 
(MAY  NOT  BE  USED) 


UNLESS  SS6, 

OUTPUT  ON  LP 

FEAT(l,J),hl^20J;l-*NFV 


YES 


SAVE  UP  TO  200  FEATURES 

IN  CORE: 

NSAV  «-  MIN  (20*NFV,  4000 

AND 

FOR  1=1,  NSAV 

SAV  (DEFEAT  (1,1) 

AND  FLAG  (l)-0 
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DATA  CARD 
FLAGS  OVERLAY 
OF  NEW  DATA 
OR  SAVING 
OLD  DATA 


(   460  ) 


DATA  CARD 

FLAGS  SECONDARY  OR  PRIMARY 

FEATURE  CONTROL  FOR 

BUS  DETECTOR 


DECODE  INCARD(l) 

INTO 

MODE  2  USING 

2301  F0RMAT(16I) 


C    470     ) 


DATA  CARD 
FLAGS  TRADEOFF 

LISTING  ON  NEW 
FEATURE  VALUE 


C  48Q  ) 


INC  FLAGC9) 

AND 

DECODE  INCARD(1)INT0 

ITV2  (FLAG  (4))  USING 

2302  FORMAT  (I) 


DISPERSION 
MEAN  W/IN  CLASS 
ACROSS  CLASS 

ct2MATRICES,ETC. 


DATA  CARD 
FLAGS  FEATURE 
TRANSFORMATION 
CONTROL  USING 
PARAMETERS  IN 
INCARD 


DECODE  INCARD(1)INT0 

NPCON  USING 

2302  FORMAT  (I) 

AND 

OUTPUT  NPCON  ON  LP. 


PROJECTION  OF 
FEATURES 
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-9 


11 


C    490     ) 


REASSIGN  FEATURE 
VECTOR     TYPES 
OR  INCLUDE  NEW 
TYPES 


DECODE  INCARD(l)  INTO 
NT,  INCARDC2-NT+1) 
INTO  LRSN(l-NT)  USING 
2301    FORMAT  (161) 
AND  SET  FLAG(5)~1 


Q     3100  ) 


DATA  CARD 
CONTAINS  FIRST 
FEATURE  CARD  FOR  BUS 
DETECTOR 


INC(NFV) 

FEAT(1,NFV)~NFV 

INC(FLAG(D) 

AND  DECODE  INCARDd+5) 
INTO  FEAT(J,NFV) 


FEAT  (2,NFV)-d  INCARD  (1) 
FEAT  (3,NFV)~d  INCARD  (2) 
FEAT  (5,NFV)~d  INCARD  (3) 
FEAT  (6,NFV)~d  INCARD  (4) 
FEAT  (7,NFV)-d  INCARD  (5) 

USING  FORMAT  #2301 


FEAT(5,NFV)~FEAT(7,NFV) 

+10*FEAT(5,NFV) 
FEAT(F,NFV)-0 
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3110 


DATA  CARD 
CONTAINS  SECOND 
FEATURE  CARD  FOR  BUS 
DETECTOR 


DECODE  INCARD  (1-9) 

INTO  FEAT(11-19,NFV+1) 

USING  FORMAT  #2301 

AND 

FOR  J=NFV,1,-1 


OUTPUT  TY'NO  MATCH' 
OUTPUT  LP 'NO  MATCH' 
FEAT(11,NFV-KL) 
FEAT(12,NFV+1) 


BUILD  NEW  FIRST  CARD 
FOR  DUPLICATE  RUN 
NUMBERS:  FOR  1=2,6 
FEAT(I;NFV+1)~ 
FEAT(I,J) 


I 


NFV-NFV+1 
J  _  NFV+1 
FEAT(1,J)-J 


FEAT(7,J)-FEAT(11,U 

FEAT(4,J)-7 

AND  F0RK=1,F 

FEAT(10+K,J).- 

FEAT(12+K,U 
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FEAT(10,N)  FILLED  HERE, 
W'CLASS  NUMBER  USING 
TYPE  IN  FEAT(3,N)  AND 
LOOK-UP  TABLE  IN  CLAS 
ARRAY,  CLASS  COUNTS 
STORED  IN  NS 


DATA  PREPARATION 
MODULE 

OUTPUT  LP  &TY 
'PREP' 
FORI=0,10;NS(I)-0 


FOR  K=1,NFV 

DETERMINl  CLASS  NUMBER 
FROM  TYPE,  EXTRACT 
SELECTED  FEATURES, AND 
llNC.CLASSI  SAMPLE  COUNT 

i . 


l-FEAT(10,K).-MIN(CLASS, 

(FEAT(3,K)),NC)  FOR  J=l, 

NF 

FEAT  (10+J,K)- FEAT 

(SFEAT(J)+10,K) 


|  YES 

NSS-0 

FOR  l=l,NC 

NSS-NSS+NS(I) 

AND 

OUTPUT  LP  1:0-10 

NS(1):I=0-NC 

OUTPUT  TY    ■ 
ERROR', NSS 


YES 


SECONTARY  FEATURE 

EXTRACTION  FOR  BUS 

DETECTOR: 

J  -  1 

(MODE  =  1  OR  2  ) 


FACT  -FEAT  (11,  K)+  FEAT 

(12,  K) 

AND  IF  MODE  2=2 

FACT-FEAT   (12, K) 

AND  F16  -1000  *FEAT(11,K) 

'FACT 


FEAT  (1 1 ,  J )  - 1 0  0  0  *FEpfa\2''  K) 
FEAT(12/J)^1000*jrE^ATc(^4'K) 
FEAT~FEAT(13,  K)+FEAT(14,  K) 


FFATfn    II    FEATQ6, 10*1000 
FEAT  (13,  J  >-       FEAT(i5K) 

FEATQ4    n    FEAT(17,K)*1000 
FtAT(14,J) FEATrfTTW — 


FEAT(15,J)TACT 
FEAT(16,J)-F16 


FEAT(12,J)-FEAT(11,J)+ 
FEAT(12,J) 
FOR  1=1,10 
FEAT(I,J)-FEAT(I,K) 
FEAT(4,J)-4;INC(J) 


NFV  -J-l 

OUTPUT  LP,  MODE  2 

MODE  2-0 

END  BUS  DETECTOR  FEATURES 
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PROCESS  COEFFICIENT 
CAROS, TYPES  1-10 
AND  CALCULATE  ALL 
FUNCTIONS  USING  TEMP. 
VECTORS  (ITV)  BEFORE 
REPLACING  ORIGINAL  FEAT 


FOR  K=1,FLAG(3) 
WRITE  LP  ITV(K), 
ITV(10+K),TV1(K) 
TM1  (J,K),  J=l,  NF 


FOR  N=,NFV 
1: 

FOR  K=l,FLAG(-3) 
Y-TVKK) 
FOR  J=1,NF 

Y-Y+TM1(J.K)*FEAT(10+ 
J,N) 
TV3(K)-Y 
CONTINUE  1 


2: 

FOR  K=1,FLAG(3) 

ITV(K)>10=»  CONTINUE? 

FEAT(10+ITV(K),N)-TV3(K) 

*!TV(1Q+K) 

+  .5 

CONTINUE  2 


FLAG(3)~0 
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X-  0 

Y-  1 
OUTPUT  LP  'SUB- 
SPACE' 


VSUM  OUTPUTS 
TV1  =  XTVI  +  YTV3 

MVPROD  OUTPUTS 

TV3  =  BCOV  •  TV1 


PROJECT  FEATURES  ONTO 
A  SUBSPACE  OR  IT'S 
COMPLEMENT- SUBSPACE 
DEFINED  BY  A',  HELD 
IN  TM1. 


NSPAN  -  FLAG  (3) 
SCALE  -  ITV(ll) 
SCALE  =  0  =  SCALE  «-l 


CALCULATE  THE  PROJECTION 
MATRIX;  STORE  IN  BCOV, 

AT  IN  TM1,  PUT  A  IN 
TM2  : 

CALL  TRANSPfTMl, 

TM2,  NF) 


CALL  MPROD  (TM2,  TM1, 
TCOV,  NSPAN,  NF, NSPAN) 
TCOV  •-  TM2  •  TM1  =  AA' 

;™21NSPANXNF, 
.TM1 j NFXNSAN 


CALL  TDINVR  (K1,K2, NSPAN, 
NSPAN,  TCOV,  10,  ITV, 
DET)  ; 

OUTPUT  LP,  'INVERSE'  , 
Kl,  K2,  DET 


CALL    MPROD(TCOV,  TM2, 
WCOV,  NSPAN,  NSPAN,  NF) 

CALL  MPROD  (TM1,  WCOV, 
BCOV,   NF,  NSPAN,  NF) 


NOW  HAVE 
PROJECTION  MATRIX 

BCOV=  AT  WCOV 

=  AT  TCOV  A 


X-  1 
Y-  1 


OUTPUT  LP 
MENT' 


COMPLE- 


,   FOR  N  =  1,NFV 
'  FOR  1=1,  NF 

:1  TVKD-  FEAT  (10+1,  N) 
CALL  MVPROD  (BCOV,  TV1,  TV3, 
NF) 

CALL  VSUM  (X,TV1,  Y,  TV3,  TV1, 
NF) 

2:   FOR  1=1,  NF 
:2  FEAT  (10+1,  N)  -  SCALE  *  TV1 

(1)  +  0.5 
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NOTE 

FEAT  (10,  N)  =  CLASS  NO.  FOR  EACH 

FEATURE  VERTOR 

1' N'NFV 


1TV2  -  TRADEOFF  LISTING 


CALCULATE  STATISTICS 
OUTPUT  LP  DATE,  ID,  ID1,  'STAT 
OUTPUT  TY  'STAT' 
FOR  1=1,  2630  ;CLR 
(XBAR(I,D) 


1: 

FOR  L=l,  NFV 

KL*-FEAT  (10, 

L) 

CALC.  DISPERSION  MATRICES 

CLASS 
CALL  V0PR0D(TV1,TV1,TM1,NF) 
CALL  MSUM(1.,DISP(1,1,KL), 
P,TM1,DISP(1,1,KL),NF) 
:1  CONTINUF    


LIST  CLASS  MEAN  VECTORS  IN 
XBAR  (lrNF,l-NC) 
AND  CLASS  DISPERSION 
MATRICES 
DISP(1-NF,1-NF,  1-NC) 


TMKI,l)-0 
1*1*  200 


FOR  K-l,  NC 


EXCUTE  TRADEOFF  LISTING  OPTIONS 

1:FOR  M=l,  FLAG  (4) 

MQ«-ITV2(M) 
OUTPUT  LP  DATE,  ID,  ID1,  MQ 

MP«-2 

MQ<0  =  MQ<-MQ 
MP«-4 

MQ>10  =  C0NTINUE  1: 

2- 

FOR  1=1,  NFV 

SCORE  (DEFEAT  (MQ+10,  I) 
CALL  TRADEOFF  (NC,  NF,  NFV, 
FEAT,  TV1,  0.,  TV2,  NS, 
SCORE,  MP) 

:2    CONTINUE 
:1    CONTINUE 


FLAG(4)«-0 


COMPUTE  CLASS  MEAN  OUTER 
PRODUCT  IN  TM2 

TM2  =  [  m(i)  m(j)  "I  NF  X  NF 

WHERE 

in(i)=XBAR(i,K),l*i<  NFS  10 


COMPUTE  WITHIN  CLASS 

COVARIANCE 

COV(i,  j,  K)=  DISP(i,j,K)- 

TM2(i,j) 
l<i,  j<NF 


ACCUMULATE  OVERALL  MEAN 
XBART(i) -XBART  (i)  + 
PROB(K)  *XBAR  (i  K) 
l<i  <NF 


MEAN  OUTER  PRODUCT, 

OVERALL 

TM1  (i,j)«-TMl(i,j)  + 

PROB(K)  *TM2(i,j) 

1<  i,j«NF 


MQ  IS 

FEATURE 

NUMBER 

TRADEOFF  CALLED 
W/MODE  (MP)  =  2 
OR  4  ONLY 
UNLESS  PROG. 
ALTERED 


ACCUMULATE  OVERALL 
WITHIN  CLASS  COVARIANCE 

WCOV(i,j)«-WCOV(i,j)  + 

PROB(K)  COV(i,j,K) 
l«l,j<NF 


:1  CONTINUE 


OVERALL  BETWEN  DISPERSION 
TM2(i,j)-XBART(i)  *  XBART(j)  I 
OVERALL  BETWEEN  COVARIANCE 


BCOV(i,j)' 


TMl(i,j)- 

TM2(i,j) 


TOTAL  COVARIANCE 
TCOV  (i,j)~WCOV(i,j)  + 

BCOV(i,j) 
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CLR  (TMKI,j)) 
FOR  K=l,  NC, 
TMl(l,j)*-TMl(i,j)  +  PROB(K)* 

DISP(i,j,K) 
1<  i,j<NF 


OVERALL  DISPERSION  LESS 
BETWEEN  DISPERSION 

TMl(i,j)<-TMl(i,j)-  TM2(i,j) 
(COV.  CHECK) 


LIST 

XBART 
AND 
CLASS  COV. 

(COV(l,j,K)) 


YES 


LIST 

TOTAL, -TCOV 

BETWEEN, -BCOV 

AND  WITHIN 

CLASS 

COVARIANCES 


CALCULATE  CORRELATIONS, 
CALC.  AND  LIST  CLASS  CORR. 
1:  FOR  K=l,  NC 

TV2(I)«-1.     /\/COV(i,l,K)' 

ls  |  <NF  crmrm  J 


(TVKD) 


COMPUTE  CORRELATIONS 

TM2(i,j)  «-TV2(D  *  COV(i,j,K) 
*  TV2(j) 


PRINT  STANDARD 
DEVIATIONS  (TVKD) 
AND  CORRELATIONS 
:1  CONTINUE 


FOR  1=1,  NF,  COMPUTE  STAN- 
DARD DEVIATIONS 

TMKI,1)<-  /TCOVd,!)' 

TM2(I,2)  «-VwCOV(l,l)' 

TM1(I,3)  -VBCOVd,!)1 


TMKI,J+3)<-l.  /TM1(I,J) 
1<I<NF 
1<J<3 


CALC.  AND  LIST  TOT.  CORREL 

TMKi,4)*TC0V(i,j)* 

TMl(j,4)-TM2(i,j) 

l<i<NF 


CALC  AND  LIST  WITHIN  CORREL. 
TM2(i,j)«-TMl(i,5)* 

WCOV(i,j)* 

TMl(j,5) 


CALC.  AND  LIST  BETWEEN 
CORREL. 

TM2(i,j)*-TMl(i,6)* 
BCOV(i,j)* 
TMKj.6) 


_L 


CALC.  AND  LIST  DISTANCE 

MATRIX 

1:  FOR  K=l,  NC 

COMPUTE  MEANS  RELATIVE 
TO  TOTAL  MEAN 
TM2(i,K)<-XBAR(i,K)- 

XBART(i) 
:1    CONTINUE 


CAL.  DISTANCE  MATRIX 
FOR  l=l,NC.tJ=l,  I 

TM1(I,J)  *-S     TM2(i,D* 
i=] 

TM2(i,J) 
TM1(J,I)«-TM1(I.J) 


NORMALIZE 


FOR  1=1, NC  (TVKD  =VtMKI,D) 

TV2(I)«-  TTM1  (1,1)  1-1/2 

AND 

TM2(i,j) «-  TV2(i)*TMKi,j)*TV2(j) 


CALC,  LIST  PAIRWISE  DIST. 
FOR  1=2,  NC,  J=l,  1-1 

TMKI,J)=TMKJ,D«-[TMKI,I) 

+TMKI,J)-2.*TVKD*TVKJ)* 

TM2  (l,J)f 1/2    


LIST  COSINES, 
CENTER  TO  MEAN  DISTANCE 
IN  TVKD  ;  i=l,  NC 
DIRECTION  COSINES  IN 
1,  NC 


TM2  (i,j)  ; 


;1,  NC 


CONVERT  TO  DEGREES  AND 
LIST: 
1:  FOR  1=2,  NC 

J=l,  NC-1 
COS  -TM2(I,J) 

SIN  «-Vl-C0S**2' 


TM2(I,J)*-ATAN(SIN,C0S)* 

57.2958 
TM2(J,I)«-TM2(I,J) 
TM2(J,J)4-0. 
:1    CONTINUE 


TM2(NC,NC)«-0. 

LIST  TM2 

CONTENTS  ;  THE 
DIRECTION  ANGLES 


© 
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CLASSIFIER: 

CHOOSE  METHOD  1, 

METHOD  2; 

METHOD  3 

WITH 

KMODE=  1 

,  2,  3 

METH  OD  1:    GENERATES  THE  COEFFICIENT  VECTORS 
V  CLASS  PAIRS 

METHOD  2:    COMPUTES  PAIRWISE  WITHIN  COVARIANCE, 
EIGEN  VECTORS 

LOGICAL  MODE  (METHOD  3):    USES  FEATURES  1-LCOLNT 


1,2 


KMODE-FLAG  (2) 

1:  FOR  1=1,  NCI 
FOR  J=l+1,  NC 
JOINT,  CONDITIONAL,  PRODUCT,  AND 
WEIGHTED  PROR.  USING  PROB(I),  PROB(J) 


PP  =  PROB(I)  +  PROB(J) 

PI  =  PROB(l)/PP 

PJ  =  PROB(J)/PP 

PIJ  =  PI*PJ 

QIJ  =  PIJ*(J-I) 

Y=  I  *PI  +  J*PJ 


METHOD  2 
XBART  (i)  -  PI  *XBAR(i,l)  + 
PJ*XBAR(i,J) 
TVKi)  *■  QIJ*(XBAR  (Z,J>- 

XBAR  (i,D) 
Li  i<NF 


LOGICAL  MODE  CLASSIFIER 
1:  FOR  N=l,  NFV 

SCORE  (N)  "0 
2:  FOR  L=l,  LCOUNT 

SCORE  CN)  -  2*SC0RE  (N) 


METHOD  1     1 


'NF 


XBART  (i)-PI  *XBAR(i,l)  + 
PJ*XBAR  (i,J) 
TVKI)  ^QIJ*XBAR(i,J)-  QIJ  * 
XBAR  (i,l) 


PAIRWISE  WITHIN  COV.   : 
TM2(i,j)  -  XBAR(i,l)  *  XBAR  (j,l) 
TMl(i,j)  «-  PI  *DISP  (i,j,l) 
-PI  *TM2(i,j) 


SCORE  (N)  *■ 
SCORE  (N)  +1 

YES   ^ 

'FEAT(10+L,N) 

\    >o     ^y 

NO 

:2 

CONTINUE 

PAIRWISE  TOTAL  COV.  : 
TCOV  (i,j)«-PI  *  DISP  (i,  j,  I) 
+  PJ*DISP  (i,j,J) 
TMl(i,j)  -  XBART(i)  *  XBART(J) 


TM2(i,j)  -  TM1  (i,j)  -PJ  *  DISP  (i,j,J) 
TM2  (i,j)  <-  XBAR  (i,J)  *  XBAR  (j,J) 
TM1  (i,j)  <-  TM1  (i,j)-  PJ*TM2  (i,j) 


TCOV  (i,j)  <-TCOV  (i,j)-  TM1  (i,j) 
COMPUTE  TCOV-1: 
CALL  TDINVR  (Kj,  K2,  NF,  NF, 
TCOV,  10,  ITV,  DET) 


FIND  SMALLEST  EIGENVECTOR  TO  SCORE: 
CALL  SEVAL  (TM1,  SCORE,  Z,  TM2,  ITV, 
NF 


1.1 


NF) 
SCORE  (i)  *TV1(1)  *(j-l) 
6TT 


COEFF.  VECTOR  TO  COV  (1,  I,  J)  : 
COV  (i,  I,  J)  -  TCOV  (i,j)  *  TVKj) 

CONSTANT  TO  COV  (I, J, J)  : 

COV(l,J,J)  -  COV  (i,l,J)  *  XBART(i)  *(-l)  +  Y 


FOR  N=l,  NF 

COV(N,J,l)  <- SCORE  (N)/  X 
(STORES  COEFF.  VECTOR) 
STORE  CONSTANT- 

COV(J,l,l)  -Y-|!F  COV  (i,J,D*  XBART  (i) 
1=1—1 


FEAT  (3,N)  - 
LRSN(FEAT(3,N)) 


YES 


YES 


SEVAL 
COMPUTES 
SMALLEST 
EIGENVECTOR, 
RETURNED  IN 
SCORE  (i), 
1=1,  NF 


CONTINUE 


OUTPUT  LP 

VALUES 
:1  CONTINUE 


FLAG  (5)  -0 
LIST  LP  DATE,  ID,  ID1, 
LCOUNT 


CALL  TRADEOFF  (NC,  LCOUNT, 
NFV,  FEAT,  TV1,  0,  TV2, 
NS,  SCORE,  3) 
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OLD  CLASSIFIER 

BEGIN: 

NAMELIST 

COMMON,  DECLARATION 

DIMENSION, EQUIVALENCE 


INITIALIZE: 


NDT  -5 
NCT  -9 
NFV  -0 
NC  -0 
NT  -0 
NF  -0 
KMODE  -0 
NPCON 
DATE 
ID 
M0DE2 


-0 
-0 
-0 
-0 


FOR  1=1,  4100 
FEAT(l,l)-0 
NSS         -0 
FOR  1=1,20 
LIST(I)    -0 
FLAG(I)  -0 


1:  FOR  IP=1,NC-1 
2:  FOR  JP=IP+1,NC 


YES 


CALLTRADEOFF(NC,NF, 
NFV^EA^COVdJP^P), 
C0V(IP,JP,JP)TV2,NS, 
SCORE,  1) 


CALLTRADEOFF(NC,NF, 
NFV,  FEAT,  C0V(1,JP,IP), 
C0V(JP/IP,IP)/TV2,NS, 
SCORE,  1) 
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SUBROUTINE  SEVAL 
(A,  EV,  LAMBOA,  B,  IV, N) 
REAL  NEWLAM,  LAMDA 
DIMENSION  A(10,10) 
B(10,10) 
IV(IO),  EV(IO) 


A    AN  NXN  SYMN.  INPUT  MATRIX 

B  -NXN  WORKING  ARRAY 

IV -INTEGER  VECTOR  WORKING  ARRAY 

EV  ^EIGENVECTOR  ON  EXIT  (SMALLEST) 

LAMDA  ^A  REAL,  RETURNS  EIGNNVALUE      (SEE  THE  9300 
HANDOUT  ON  SEVADCORRESPONDING  TO  EV 


FOR  1=1,  N 
FOR  J=l,  N 
B(I,J)«-A(I,J) 
CALL  TDINVR  (K1,K2,N, 
N,B,10,IV,DET) 


T-0. 

FOR  1=1,  N 
T«-T+B  (1,1) 
LAMDA  =  l./T 


1:    FOR  K=l,  10 
2:    FOR  1=1,  N-l 

B(I,I)«-LAMBA-A  (1,1) 
3:    FOR  J=l  +  1,  N-l 

B(J,D— A(I,J) 

B(I,J)«-  B(J,I) 
:  3  :  2    CONTINUE 
CALL  TDINVR  (KVK9,N-1 

N-l,  B,  10,  IV!  DET) 


EV(i)«-B(i,j)*A(j,N) 
i=  N,  N-l  j=l,  N-l 

EV(N)-1 


ir 

VMAG^E     (EV(i)) 
i=l 
NN 
NEWLAM  ~ZX  EV(j)  A(j,i)  EV(i) 
j  =  ii=l 
NEWLAM   <-NEWLAM/VMAG 


T-E      A(i,N)EV(i) 
T  «-ABS(NEWLAM-T-A(N,N) 


YES 


LAMDA -NEWLAM 
:  1  CONTINUE 


OUTPUT  (TY)  'SEVAL 
NOT  CONVERGING1 


(   RETURN    ] 


Figure  20.     Flow  Charts  (Continued) 
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SUBROUTINE  TRADEOFF 

(NC,  NF,  NFU,  FEAT, 
TV1,  B,  TV2,  NS, 
SCORE,  MODE) 


TABULAR  OUTPUT  OF  TRADEOFF  CURVE  DATA 
FEAT-  FEATURE  VECTOR 
TV1  -  COEFFICIENT  VECTOR 
B  -  CONSTANT  TERM 

TV2,  NS,  SCORE  -  TEMPORARY  SCRATCH 

NF 
TRADEOFF  COMPUTES  Y=^  TVKi)  •  X(i)  +  B  FOR  ALL  FEATURE  VECTORS 

i=l 

X~  FEATURE  VECTOR  WITH  X(l)=  FEAT  U1,N),  X(2)  =  FEAT  (12, N),  ETC. 

HYPERPLANE  TVKI NF)  w/  B-  DISTANCE  FROM  ORIGIN 

THUS  Y  =  d(X,  HYPERPLANE) 

MODE  =  2,3,4  PRESUMES  SCORES  ALREADY  CALCULATED 
=  3  SCORES  ARE  OUTPUT  IN  OCTAL 
=  4  OUTPUTS  FEAT  (1,  ...  ,  10),  ORDERED  BY  SCORE 
=  11,  12,  13,  14  SUPPRESSES  PRINTING 


ode\. 

>10        . 

7          S' 

YES 

MODE«- 
MODE  -10 
LL^  2 

Jl MO 

2,3,4 


OUTPUT  LP  B,  TVKi) 
AND  CALCULATE  SCORES 
FOR  N-l,  NFV 
SCORE  (N)«- Y 
(Y  OR  ABOVE) 


RANK  THE  SCORES 

FEAT  (8,N)-0  FOR  N=l, 

NFV 

1:  FOR  N=l,  NFV 

K<-  0 
2:  FOR  1-1,  NFV 

R  -  SCORE  (N) 


■SCOREx, 
)SR  ? 

.YES 

K-K+l 

j^NO 

FEAT  (9,N)  -  K 
:  2  :  1  CONTINUE 


1  :  FOR  N  =  1,  NFV 
K«-  FEAT  (9,N) 
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WRITE  LP 

N,  (FEAT(l,J)/l=l,2/3,5/6,7) 

K,SCORE(J),K, 
NS(K) 


WRITE  LP 

N.,(FEAT(I,J  ), 1=1,2, 3,5, 6,7) 

K,(LL=SCORL(S)),K,MS(K) 


WRITE  LP 

N,FEAT(  1,  J),  K,  SCORE  (J), 

(FEAT  (I, J),  1-11,20) 


:1  CONTINUE 


Figure  20.     Flow  Charts  (Continued) 
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SUBROUTINE  VIPROD 
(A.B,C,N,) 

A(10),B(10) 


C  -0 

1: 

FOR  1=1, N 


C-C+A(I)*B(I) 
lrCONTINUE 


SUBROUTINE  VOPROD 

(A,B,C,N,) 

A(10),B(10),C(10,10) 


FOR  1=1, N 
FOR  J=1,N 

C(I,J)«-AT(I)*B(J) 


SUBROUTINE  VSUM 

(S1,A,S2,B,C,N) 

A(IO),B(IO),C(IO) 


FOR  l=l,N 
C(I)-S1*A(I)+S2*B(I) 


(return) 


Figure  20.     Flow  Charts  (Continued) 
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SUBROUTINE  MPROD 
(A,  B,  C,  /N(L)/) 
A(10,  10),  B(10,  10), 
CdO,  10) 


NOTE: 

N(L)  A  MULTIDIMENSIONAL 

DUMMY 


Nl«-N  (1) 


N2«-N3-N1 


N2-N(2) 
N3«-N(3) 


1:  FOR  1=1,  Nl 

2:  FOR  J=l,  N3 
C(l,J)*-0. 


3:  FOR  K=l,  N2 

C(I,J)WUI,K)*B(K,J) 
+C(I,J) 


:  3  :  2  :  1 

CONTINUE 


ETURf 


Figure  20.     Flow  Charts  (Continued) 
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SUBROUTINE  MVPROD 

(A,B,C,N) 

A(IO,IO),B(IO),C(IO) 


l.-FOR  l=l,N 
C(l)-0 

2:  FOR J=1,N 


C(I)-C(I)+A(I,J)*B(J) 
:2:1  CONTINUE 


(return 


SUBROUTINE  MSUM 

(S1,A,S2,B,C,N) 

A(lO,IO),B(IO,lO),C(IO,IO) 


FOR  1=1, N 

FOR  J=1,N 
C(I,J)-S1*A(I,J)+S2*B(I,J) 


Figure  20.     Flow  Charts  (Continued) 
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SUBROUNTINE  DMDPROD 

(A,B,C.D.N) 

A(IO),C(l6,IO),C(IO),D(IO,IO) 


FOR  l=l,N 
FOR J=1,N 
D(I,J)-A(I)*B(I,J)*C(J) 


RETURN 


SUBOUTINE  TRANSP 

iA,B,N) 

A(10,10),B(10,10), 


FOR  1-1, N 
FOR  J=-1,N 
B(I,J)-A(J,I) 


TDINVR  (IS,IDS,NR,NC,A,MRA,KWA,DET 
IS-OUTPUT 


WORKING  SINGLY  DIMENSIONED 
ARRAY,  DIM  (MRA) 

OUTPUT  VAL  OF  DETERMINANT 


IDS-OUTPUT     = 


NR-INPUT 

NC-INPUT 

A-INPUT 

OUTPUT 

MRAHNPUT 


1  SOLVED/FOUND 

2  UNABLE  TO  SOLVE 

3  INPUT  ERROR 

1  DETERMINANT  CALCULATION  DID  NOT  OVERFLOW 

2  DETERMINANT  CALCULATION  DID  OVERFLOW 

NUMBER  OF  ROWS  IN  INPUT  MATRIX  A 

NUMBER  OF  COLUMNS  IN  INPUT  MATRIX  A 

NOT  PRESERVED 

INVERSE  OF  INPUT  MATRIX  A 

MAX  NR  OF  ROWS  IN  A 


Figure  20.     Flow  Charts  (Continued) 
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ENTER 


IR  =  NR 
ISOL  =  1 
IDSOL=  1 


IC=    IR 


IBMP  =  1 
JBMP  =  MRA 


KBMP  = 

JBMP+    IBMP 
NES  = 

IR*  JBMP 
NET  = 

IC*  JBMP 


MDIV=JBMP+1 
IRIC  =  IR-  IC 


MAD  =  MDIV 
MSER  =  1 
KSER=  IR 
MZ  =  1 
DET  =  1.0 


<5D 


<5) 


MDIV=  1 


PIV=  0.0 

I  =  MSER 


>  KSER 


!A 


(1)1  >PIV^ 

i 

PIV  = 

IP  =  1 

A(l)  1 

n«— — 

=  I  +  IBMP 


/(ip-in 

l=IP-   *JBMP 

\JBMP/ 

MSER-1\ 
J=MSER-| *JBMP 


JBMP 
JJ=MSER/KBMP  +  1 
11  =  JJ+  (IP-MSER) 
KWA(JJ)=  II 


PST0  =  A(l) 
A(l)  =  A(J) 
A(J)  =  PSTO 
1=  I  +  JBMP 
J=  J  +  JBMP 


Figure  20.     Flow  Charts  (Continued) 
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A(K)=A(l)*PST0| 
l=l+JBMP 


1=  MAD 
J=MDIV 
PSTO=A  (MZ) 


A(MZ)=0.0 


A(I)=A(I) 

A(J)*PSTO 
J=J+JBMP 
l=l+JBMP 


MAD=MAD+IBMP 
MZ=MZ+  IBMP 


PSTO=A(MSER) 
DET=DET*PST0 


PSTO=  1.0/ 
PSTO 


MSER=MSER+ 
KBMP 


MDIV=MDIV+IBMP 

+  1 

MAD=1 


MDIV=MDIV+ 
KBMP 


MZ=1+ 


MZ=MSER+ 
IBMP 


MAD=MZ+ 
JBMP 


■*-r« 


MZ 


MAD. 
IMDIV 


MSER 


m 


MAD 

MSER 
MDIVMZ" 


r-'- 


MDIV 

MAD 


INVERSE     WANTED     EQUATIONS   SOLVED 

NO  INVERSE- 
(NC<a|NC|>NR) 


(NC  >0) 


DETERMINANT 
UNLV 
(NC  <0, 
|nc|=NR) 
IRIC=0 


Figure  20.     Plow  Charts  (Continued) 
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K=(JR-1)*JBMP 
J=K+  IR 
L=(KWA(JR)-1) 

*JBMP 
+  IR 


1  >0 

PSTO 

=  A(L) 

A(L)  = 

A  (J) 

A(J)  = 

PSTO 

J  =  J- 

IBMP 

L  =  L 

-  IBMP 

DET  =  0.0 
ISOL  =  2 
IDSOL,=  1 


EXIT 


ISOL    =  2 
IDSOL  =  2 


EXIT 


Figure  20.     Flow  Charts  (Concluded) 
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CHAPTER  6 
DEVELOPMENT  OF  A  PASSIVE  BUS  DETECTOR 


SUMMARY 

The  classifier  algorithm  was  designed  by  analyzing  the  characteristics  of 
recorded  vehicle  signatures.     These  signatures  were  produced  by  test 
vehicles  driving  over  experimental  installations  in  Minneapolis  (Figure  21) 
and  in  Washington,   D.  C.    and  by  actual  street  traffic  in  Washington,   D.  C. 
(Figure  22)  shows  examples  of  signatures  from  nine  different  types  of 
vehicles.     A  number  of  experimental  parameters  that  could  affect  the  vehicle 
signatures  were  varied  during  the  experimental  runs.     These  include  vehicle 
parameters  (speed,   centeriine  displacement,   separation,   etc.  )  and  installa- 
tion parameters  (asphalt,   concrete,   reinforcing  mesh,    lead  wire  length, 
snow  pack,   etc.  ).     Also,   signatures  were  recorded  for  vehicles  that  stopped 
over  the  sensing  element. 

A  number  of  signal  characteristics  were  apparent  in  the  initial  recordings 
and  these  were  used  to  make  a  preliminary  definition  of  the  classifier  struc- 
ture.    First,  all  vehicles  produced  only  positive  signal  values  with  peak 
values  related  to  vehicle  mass  and  inversely  related  to  road  clearance. 
Thus,  a  signal  threshold  would  detect  vehicle  presence  and  would  reject 
most  bicycles  and  motorcycles.     Second,   vehicles  with  short  wheel  bases 
produce  a  signal  that  has  only  one  peak  value,   while  long-wheel-base  vehicles 
show  multiple  peaks.     This  suggested  that  if  the  multiple  peaks  were  consis- 
tent and  could  be  measured,    then  a  multi-stage  classifier  structure  could 
reduce  the  real-time  data  processing  rate  by  counting  peaks  and  rejecting 
most  automobiles.     The  vehicles  that  pass  this  gross  test  are  then  classified 
by  using  additional,   more  detailed  features.     This  classifier  structure  is 
shown  in  the  sketch  that  follows: 
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[3  PASSIVE  BUS 

DETECTOR  PRIORITY 
SYSTEM 


INDUCTIVE  LOOP     \  Fl 

r  i 


1    ft.    =   0.3  m 


Figure  21.     Installation  and  Demonstration,   Minneapolis -33rd 
and  Johnson  St.   NE 
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DEGREES 
PHASE 
SHIFT 


DRAY  TRUCK 


STEP  VAN 


STATION  WAGON 


VWBUG 


>  TIME 


Figure  22b.     Vehicle  Signature  Examples  (Concluded) 
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MAGNETIC 

LOOP 

PHASE 


SIGNAL 
+\  THRESHOLD 
TEST 


VEHICLE 


PRESEN 


T* 


GROSS 
TEST 


POSSIBLE 


BUS 


FEATURE 
EXTRAC- 
TION 


The  design  procedure  started  by  implementing  the  signal  threshold  test. 
Having  determined  the  threshold  value,   the  next  step  was  to  define  an  algor- 
ithm for  detecting  signal  peaks.     A  number  of  algorithms  were  formulated 
and  tested.     The  one  chosen  was  able  to  detect  all  the  major  peaks  that  were 
obvious  to  the  eye  (independent  of  the  shape  of  the  peak)  and  it  detected  a 
minimum  number  of  spurious  peaks  (small  amplitude  signal  variations  and 
noise  effects).     The  gross  test  was  implemented  next.     Eyeball  study  of 
signal  tracings  suggested  that  busses  within  four  feeftof  center  line  pro- 
duced from  three  to  six  major  peak  values.     This  test  was  implemented  and 
a  number  of  tests  were  run  against  recorded  data  using  various  lower  and 
upper  limits  to  verify  this  criterion. 

Up  to  this  point  preliminary  values  had  been  established  for  the  vehicle 
detection  threshold,   the  peak  detection  threshold  and  the  upper  and  lower 
limits  for  the  gross  test.     These  three  processing  steps  passed  all  of  the 
bus  signals  and  eliminated  more  than  90  percent  of  the  non-bus  events  that 
would  be  encountered  in  normal  traffic.     What  remained  to  be  done  was  to 
find  appropriate  signal  measurements  (features)  that  would  let  us  distinguish 
between  busses  and  the  other  vehicles  that  passed  the  gross  test.     Moving 
vans,   semis,  and  non-urban  transit  busses  are  examples  of  the  vehicles 
to  be  eliminated.     The  signals  from  these  other  vehicles  showed  roughly  the 
same  signal  shape  as  the  busses.     There  was  also  the  problem  of  signal 
shapes  being  distorted  by  a  vehicle  changing  speed  or  stopping. 


By  plotting  peak  values  versus  time  for  a  number  of  different  test  runs  it 
was  seen  that  these  signal  characteristics  contained  enough  information  for  a 

*    1    ft.    =  0.3   m 
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human  to  discriminate  between  various  vehicles  moving  with  uniform  speed. 
It  was  decided  to  attempt  a  classifier  design  using  the  peak  values  as  fea- 
tures.    This  then  led  to  a  decision  to  use  two  classifiers,   one  for  uniformly 
moving  vehicles  and  one  for  stopping  (or  non-uniformly  moving)  vehicles. 
The  time  measurements  then  served  to  determine  which  type  of  motion  was 
being  observed  and,   for  uniform  speed  vehicles,    the  time  measurements 
would  provide  a  speed  estimate  and  thus  allow  the  effect  of  speed  differences 
to  be  removed.     The  final  uncontrolled  non-significant  variable  was  the 
change  in  signal  magnitude  caused  by  the  displacement  of  the  vehicle  from 
the  loop's  center  line.     It  was  decided  that  this  effect  could  be  treated  as  a 
signal  attenuation  factor  that  did  not  change  the  signal  shape  and  its  effect 
was  removable  by  normalizing  the  signal  amplitudes. 

The  amplitudes  of  the  signal  peaks  were  normalized  by  dividing  each  peak 
amplitude  by  the  amplitude  of  the  first  peak.  Thus,  amplitude  of  the  first 
peak  of  the  normalized  signal  is  always  equal  to  1.  The  measurements  of 
peak  magnitudes  and  times  (primary  features)  thus  had  to  be  transformed  or 
normalized  into  values  called  secondary  features  that  were  independent  of 
vehicle  speed  and  lateral  displacement.  The  normalization  is  described  in 
the  following  two  paragraphs. 

To  perform  the  feature  analysis  and  the  classifier  design,    the  primary  fea- 
tures were  punched  on  cards  for  input  to  the  XDS9300  digital  computer.     A 
number  of  methods  for  normalizing  the  peak  magnitudes  and  times  were 
tested  using  the  primary  features  from  vehicles  that  passed  the  gross  test. 
It  was  found  that  the  ratio  of  Nth  peak  magnitude  to  1st  peak  magnitude  pro- 
vided the  necessary  magnitude  normalization.     (That  is  to  say,   the  ratios 
M- /ML,   Mg/M-, .  .  .  ,   Mg/M-  where  MN  is  the  Nth  peak  magnitude.  ) 

Normalizing  the  time  values  was  not  as  easy.     A  velocity  estimate  was  the 
ideal  normalizing  factor,   but  this  required  knowing  the  length  of  the  vehicle 
and  that,    in  turn,   required  knowing  what  kind  of  vehicle  made  the  signal. 
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An  attempt  was  made  to  use  the  total  signal  duration,  but  this  caused  all 
vehicles  to  have  the  same  signal  length  and  produce  confusion  between  long 
and  short  vehicles.     The  normalizing  factor  finally  used  was  the  sum  of  the 
time  from  vehicle  detection  to  first  peak  plus  the  time  from  last  peak  to  end 
of  detection.     The  primary  time  features  were  divided  by  this  factor  to  pro- 
duce the  (normalized)  secondary  time  features.     The  normalized  time  from 
detection  to  first  peak  was  found  to  be  near  0.  5  for  all  vehicles  moving  with 
uniform  velocity,   thus  the  moving  versus  stoped  vehicle  test  was  based  on 
this  value.     (The  test  was  later  modified  to  separate  uniform  and  non- 
uniform speeds.     The  non-uniform  speed  classifier  then  was  concerned  with 
accelerating  and  decelerating  vehicles  as  well  as  stopping  vehicles. ) 

One  more  decision  was  made  to  simplify  the  classifier  structure  -  that  only 
the  first,   second  and  last  peaks  (magnitude  and  time)  would  be  used  to  gener- 
ate secondary  features.     Any  peaks  detected  between  the  second  and  the  last 
would  be  ignored.  *    Since  every  signal  passing  the  gross  test  showed  three 
or  more  peaks  and  since  all  the  recorded  bus  signatures  had  three  major 
peaks,   it  was  felt  that  this  constraint  would  not  limit  the  classifier  perform- 
ance.    In  terms  of  classifier  structure,   each  primary  feature  set  contained 
the  same  number  of  measurements,  regardless  of  how  many  peaks  were  de- 
tected.    The  classifier  equations,   therefore,   did  not  have  to  account  for  the 
varying  number  of  peaks.     The  validity  of  this  choice  and  the  normalizations 
were  established  by  the  classifier  performance. 


Seven  memory  locations  are  used  to  store  the  three  peak  magnitudes  and 
the  four  time  values.     Denote  these  locations  by  (MJ,   (M  ),   (M,  ),   (T„), 
(T..),   (T~),   (TT  ).     When  the  first  peak  is  detected,   its  values  are  stored  in 
(]VL),   (TQ).     The  second  peak  is  stored  in  (IVU),   (T.).     If  there  are  more 
than  two  peaks  then  they  are  stored  in  (ML),   (Tg)  with  each  new  peak  writing 
over  any  information  previously  stored  there.     The  time  at  the  end  of  the 
signal  is  stored  in  (TL).     Thus,   the  last  detected  peak  appears  in  (M^),   (Tg) 
at  the  end  of  the  signal.     Figure  23  shows  the  origins  of  the  seven  features 
from  an  idealized  vehicle  signature. 
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SIGNAL 
MAGNITUDE 


TIME 


PRIMARY  FEATURES 


1 


0 


=  TIME  FROM  TURN  ONTO  FIRST  PEAK 

TL  =  TIME  FROM  LAST  PEAK  TO  TURN  OFF 

T^  =  TIME  FROM  FIRST  PEAK  TO  SECOND  PEAK 

Ts  =  TIME  FROM  SECOND  PEAK  TO  LAST  PEAK 

M<\  =  MAGNITUDE  OF  FIRST  PEAK 

M2  =  MAGNITUDE  OF  SECOND  PEAK 

M,  =  MAGNITUDE  OF  LAST  PEAK 


Figure  23.     Primary  Feature  Measurements 
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The  secondary  feature  set  then  had  two  normalized  magnitudes  and  two 
normalized  time  intervals.     A  graphical/statistical  analysis  was  performed 
to  determine  whether  these  secondary  features  contained  enough  information 
to  distinguish  between  busses  and  other  vehicles.     For  this  analysis,    the 
thresholds  were  set  to  allow  an  abnormally  large  number  of  non-bus  runs  to 
pass  the  gross  test     This  provided  signatures  from  the  three  busses  that 
had  been  used,   plus  signatures  from  six  other  vehicles  (Volkswagen,   station 
wagon,   step  van,   dray  truck,   semi  and  moving  van).     Figure  24  shows  the 
normalized  signature  averages  for  these  nine  vehicle  types.     Each  of  these 
was  treated  as  a  separate  vehicle  class  and  the  sizes  and  locations  of  these 
nine  clusters  was  calculated.     The  results  were  that  eight  clusters  were 
located  close  to  a  two-dimensional  plane  in  the  four -dimensional  space  of 
secondary  features  (the  moving  van  was  the  maverick),    the  three  bus  clusters 
and  the  moving  van  cluster  were  close  to  each  other  but  far  from  the  other 
five  clusters.     Figure  25  is  a  polar  plot  of  the  nine  different  vehicle  class 
means. 


DESIGN  OF  THE  MOVING  VEHICLE  CLASSIFIER 

With  this  evidence  in  favor  of  the  four  secondary  features  being  sufficient, 
the  next  step  was  to  determine  equations  for  a  classifier.     The  method  used 
was  to  arbitrarily  assign  a  number  to  each  cluster  of  data  samples  (for 
example:    1  denotes  bus,    2  denotes  semi,   3  denotes  truck,   etc.).     These 
are  called  "class  values".     Then,   considering  the  class  values  as  a  function 
defined  at  the  sampled  points  in  the  four -dimensional  space  of  secondary 
features,   a  linear  function  (called  a  "Discriminant")  is  found  that  gives  the 
best  least-squares  fit  to  the  class  values,     (Ideally  this  function  will  be 
near  1  for  all  the  points  in  cluster  number  1,   near  2  in  cluster  2,   etc.  )    For 
the  general  multiclass  problem  (more  than  two  classes)  this  method  requires 
that  the  class  values  be  permuted  to  determine  the  minimum  least-square 
error,   but  our  problem  involved  only  two  classes  (bus  and  not  bus)  so  this 
step  was  not  necessary.     Having  determined  the  discriminant,    the  classifica- 
tion decision  was  made  by  comparing  the  function  value  with  a  fixed  threshold 
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NORMALIZED 
MAGNITUDE 


M1/M1 =  1 


NORMALIZED 
TIME 


FLXIBLE  BUS  NO.  1     (AVERAGE  OF  11  BUS  RUNS) 


FLXIBLE  BUS  NO.  2      (AVERAGE  OF  23  BUS  RUNS) 


GMC  BUS  (AVERAGE  OF  17  BUS  RUNS) 


Figure  24a.     Normalized  Signature  Average 
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SEMI    (AVERAGE  OF  8  RUNS) 


MOVING  VAN    (AVERAGE  OF  11  RUNS) 


TRUCK    (AVERAGE  OF  7  RUNS) 


STEP  VAN    (AVERAGE  OF  9  RUNS) 


STATION  WAGON    (AVERAGE  OF  2  RUNS) 


TORINO    (AVERAGE  OF  2  RUNS) 


Figure  24b.     Normalized  Signature  Average  (Concluded) 
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Figure  25.     Polar  Plot  of  Subclass  Means 
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value;  small  values  give  one  decision,  and  large  values  the  other.     For  the 
bus  classifier  it  was  not  possible  to  find  a  single  discriminant  that  would 
correctly  classify  all  of  the  experimental  data.     In  the  two  best  cases,   one  of 
them  classified  some  of  the  moving  van  examples  as  bus  and  the  other  called 
all  of  the  trucks  busses.     However,    the  combination  decision  rule,    that 
decides  "bus"  when  both  discriminants  indicate  "bus",   correctly  classified 
all  of  the  experimental  data.     Figure  26  shows  the  two-dimensional  distribu- 
tion of  the  test  data.     The  region  to  the  left  of  2.  89  and  below  1.  57  is  the 
bus  region.     Neither  threshold  by  itself  can  separate  the  bus  samples  from 
the  others. 
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/ 

sv 


/ 


Tr 


/ 


,SW,T 


1.57 


-ar" 


•~*ffiv-^"" 


2.89 
K„  = 


4.83-1.66S     +  1.36S     +2.17S     -4.10S 
I 1 — 


-*■  K- 


Figure  26.     Joint  Plot  of  Moving  Vehicle  Discriminant  Values 

The  above  step  in  the  bus  detector  data  analysis  was  performed  using  the 
CTC  classifier  program.     Feature  vector  inputs  comprised  of  "eleven"  and 
"twelve"  cards  and  the  primary-to-secondary  feature  transformation  code 
in  the  main  program  (controlled  by  a  "minus  six"  card)  were  used.     Several 
runs  were  made  initially,   using  various  combinations  of  selected  features 
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and  type-to-class  assignments,    to  determine  the  basic  data  distributions 
and  possible  discriminants.     From  these,   discriminants  and  thresholds 
were  selected  to  be  used  in  the  logical  mode  classifier.     The  logical  mode 
classifier  was  executed  using  five  logical  variables  and  nine  logical  variables, 
and  Karnaugh  maps  were  made  from  the  output  of  each  execution. 

Analog  data  were  recorded  from  the  buried  loop  detector  for  various  vehicles, 
including  buses,   vans,    trucks,   and  large  and  small  automobiles.     A  type 
was  assigned  to  each  vehicle  and  was  recorded  at  the  time  of  the  vehicle's 
passing  the  loop.     The  resulting  analog  data  were  transformed  into  digital 
data  (primary  features)  and  placed  on  "eleven"  and  "twelve"  cards  to  be  used 
by  the  program.     Vehicle  types  were  defined  as  follows: 


Vehicle 

Type 
(Moving) 

1 

(Stopped 

Type 

over  the  loop) 

Flxible  Bus  1 

11 

GMC  Bus 

2 

12 

Flxible  Bus  2 

3 

13 

Semi 

4 

14 

Truck 

5 

15 

Step  Van 

6 

16 

Moving  Van 

7 

17 

Station  Wagon 

8 

18 

Torino 

9 

19 

Volkswagen 

10 

20 

Each  feature  vector  card  pair  contained  seven  primary  features,   along  with 
data  describing  the  road  surface,   vehicle  speed,   displacement  from  loop 
centerline,   vehicle  type,    trial  number,   and  run  number. 

The  program  includes  a  block  of  code  to  transform  primary  bus  detector 
features  into  secondary  features  which  are  normalized  features  or  combina- 
tions of  features.     These  secondary  features  are  "best"  for  the  problem  of 
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vehicle  classification  in  this  application.     Two  transformations  are  avail- 
able which  differ  in  the  normalizing  factors  used;  control  of  which  transforma- 
tion is  applied  is  through  the  use  of  the  "minus  six"  control  card,    described 
elsewhere.     Table  40  shows  the  seven  primary  features  and  the  two  trans- 
formations available.     In  this  table,    TQ  is  the  time  from  vehicle  entrance 
into  the  loop  detection  region  until  the  first  amplitude  peak  in  detector  out- 
put,   T,    is  the  time  from  the  last  amplitude  peak  until  vehicle  exit  from  loop 
detection  region,    T..   is  the  time  between  the  first  and  second  amplitude  peaks, 
and  To  is  the  time  between  the  second  and  last  amplitude  peaks.     Also,   M1 , 
M„,   and  M,    are  the  amplitude  values  of  the  first,   second,   and  last  ampli- 
tude peaks,   respectively. 

Secondary  feature  S1   is  the  normalized  time  between  the  first  and  second 
amplitude  peaks,   S„  is  the  normalized  time  between  the  second  and  last 
peaks,   S„  is  the  normalized  amplitude  of  the  second  peak,  and  S4  is  the 
normalized  amplitude  of  the  last  peak.     These  four  secondary  features  can 
be  used  to  classify  uniformly  moving  vehicles.     Secondary  features  Sfi  and  S„ 
are  the  normalized  time  from  vehicle  entry  into  the  loop  detection  region 
until  the  first  amplitude  peak  and  the  normalized  time  between  the  first  and 
last  peaks,   respectively.     These  two  features  can  be  used  to  determine 
whether  or  not  a  vehicle  is  moving.     The  factor  "1000"  appearing  in  these 
normalized  features  is  necessary  because  the  program  will  use  only  the 
integer  part  of  any  feature  value. 

In  order  to  determine  linear  discriminants  and  thresholds  which  could  be 
used  with  the  logical  mode  classifier,   several  runs  were  made  using  the 
method  one  classifier.     One  of  these  runs  used  secondary  features  1,   2,    3, 
and  4,   and  the  MODE  2  =  1  transformation.     For  this  run,    types  1,    2,   and  3 
(moving  buses)  were  lumped   together  in  class  1;  types  4,    5,    6,   7,   8,   9,   and 
10  (other  moving  vehicles)  were  called  class  2;  and  all  non-moving  vehicles 
(types  11  through  20)  were  assigned  to  no  class,   which  shows  as  class  0  in 
the  execution.     Class  1  and  class  2  were  assigned  equal  a-priori  probabilities 
of  0.  50,   and  the  method  1  classifier  was  executed  on  the  feature  vector  set. 
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TABLE  40.     PRIMARY  AND  SECONDARY  FEATURES 

AVAILABLE  IN  CTC 
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The  result  of  this  run  was  a  linear  discriminant  for  moving  busses  versus 
other  moving  vehicles  (see  Table  41). 

Although  the  other  0  vectors  were  not  classified,   and  occurred  throughout 
the  range  of  scores  formed  by  the  discriminant,   all  moving  buses  had 
scores  less  than  1.471,  while  all  other  moving  vehicles  had  scores  greater 
than  this  value.     Thus  a  linear  discriminant  which  separates  moving  vehicles 
into  busses  or  nonbusses  perfectly  (with  this  training  set  of  feature  vectors) 
has  been  found,   and  by  selecting  a  threshold  near  1.471,   a  logical  variable 
may  be  formed  which  is  false  for  any  moving  bus  and  true  for  any  moving 
nonbus.     The  threshold  which  was  actually  chosen  was  not  1.  471  but  1.  57; 
this  threshold  causes  four  moving  nonbusses  of  the  moving  van  variety  to  be 
called  class  1  (moving  busses).     This  seemingly  nonoptical  threshold  was 
chosen  because  of  the  closeness  of  moving  vans  to  busses  in  the  decision 
space  and  to  prevent  a  moving  bus  from  being  rejected  in  a  real-world  situ- 
ation, at  the  expense  of  a  few  misclassified  moving  vans.    Another  dis- 
criminant may  be  used  to  make  the  choice  between  bus  or  moving  van  using 
a  decision  space  in  which  these  two  types  are  farther  apart. 

Such  a  decision  space  was  found  in  a  different  execution  of  the  method  1 
classifier;  this  run  was  similar  to  that  previously  described,   with  the  mode 
2  =  1  secondary  feature  transformation  and  use  of  secondary  features  1,   2, 

3,  and  4.     However,   instead  of  only  two  classes  of  interest,  five  were  used 
as  follows: 

Class  Contained  TVnes  Names 

Moving  busses 

Moving  semis 

Moving  trucks,   moving  step 
vans,   moving  station  wagons, 
moving  Torino  cars 

Moving  moving  van 

Moving  Volkswagen 
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1 

1,    2,    3 

2 

4 

3 

5,    6,    8,    9 

4 

7 

5 

10 
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1.9o35  13 

1.9255 

28 

1  .9272 

29 

1.9275 

30 

1°93"32  14 

2.0654 

31 

3  .  o  8 1  3 

32 

2.Q873 

33 

2*0°92 

34 

2»0950 

35 

2*0957 

36 

2  » 1 2 ::  4 

37 

2.1^34  J  5 

2.1^38 

38 

2 .1501  16 

2» 1713  17 

2*1719 

39 

2*1751 

4n 

2*1796  18 

2*1862  19 

2.2107  20 

2*2111  21 

2*2141  22 

2*2202  23 

2.3P17  ?4 

2*3274  25 

2*3292  26 

2*6-39  27 

2*6-84  ?8 

2.61 45  ?9 

2*7o30 

41 
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Types  11  through  20  were  not  assigned  to  any  class  and  are  thus  in  class  0. 
Each  of  the  five  classes  was  assigned  an  a-priori  probability  of  0.  20. 

The  output  from  this  run  included  linear  discriminants  for  each  pairwise 
combination  of  the  five  classes;  the  discriminant  of  concern  is  between 
class  1  and  class  4  (busses  versus  moving  vans).     In  the  tradeoff  listing  of 
scores  for  this  discriminant  (see  Table  42),  all  class  1  vectors  have  scores 
of  2.  6667  or  less,   while  all  class  4  vectors  had  scores  of  3.  1082  or  more. 
A  threshold  between  these  values  was  selected,   2.  890.     Since  there  is  a 
wider  separation  between  busses  and  moving  vans  in  this  decision  space,   the 
safety  margin  (or  margin  of  allowed  errors)  which  was  necessary  in  the 
previous  run  was  not  required.     The  mixing  of  classes  2,   3,  and  5  through- 
out the  tradeoff  listing  is  of  little  concern,   since  the  goal  is  to  select  be- 
tween classes  1  and  4.     Application  of  the  first  discriminant  will  select  all 
moving  busses  and  some  moving  vans.     Application  of  the  second  discrimi- 
nant to  this  group  of  busses  and  moving  vans  will  select  the  busses  and  reject 
the  moving  vans. 


DESIGN  OF  THE  STOPPED  VEHICLE  CLASSIFIER 

The  preceding  discussion  refers  to  the  moving  vehicle  classifier.     For  the 
stopped  vehicles,  only  the  normalized  signal  magnitude  features  were  used. 
For  a  stopped  vehicle,   one  of  the  time  intervals  becomes  arbitrarily  large 
and  thus  does  not  characterize  the  vehicle  class.     The  method  for  finding 
discriminants  was  the  same  as  described  above,  but  the  decision  rule  was 
slightly  different.     In  this  two-dimensional  space  the  clusters  all  lay  near 
one  line  with  the  nonbusses  at  the  outside  and  the  busses  in  the  middle. 
Thus  an  upper  and  a  lower  threshold  on  the  discriminant  values  was  needed. 
Again,   two  discriminants  were  combined  to  correctly  classify  all  of  the 
experimental  data.     Figure  27  shows  how  the  stopped  vehicle  discriminant 
values  and  the  thresholds  are  arranged. 
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TABLE  42. 


TRADEOFF  LISTING  FOR  BUS  CLASSIFIER 
DESIGN 


DATE 

1223  ID 

i?D  RUN> 

t 

TRADEOFF  FOR 

Pair 

1   4 

C8EFF 

4. 

83403 

-•OC 

16? 

•00136 

00217 

-•00*10 

M8 

ID 

TY 

CL 

SC9RE 

0   12" 

1 

64 

?98 

16 

51 

2 

21310 

0 

-15 

>*957 

1 

2 

34 

2?5 

12 

101 

0 

21310 

V 

-6 

>*«6* 

2 

3 

116 

225 

12 

101 

0 

?l9o* 

0 

-5 

•  78*3 

3 

* 

96 

359 

13 

51 

r, 

121308 

r 
J 

-* 

>3853 

4 

5 

67 

30  5 

16 

51 

-4 

L21904 

0 

- 

•  73*7 

5 

6 

94 

357 

3 

51 

-3 

121308 

- 

>3?*8 

1 

7 

82 

344 

3 

151 

3 

L2l3o8 

•  0658 

2 

8 

91 

353 

3 

51 

•2 

1213C8 

.0*95 

3 

9 

90 

352 

3 

5l 

4 

121308 

►0912 

<* 

10 

75 

337 

3 

5l 

6 

t2l3o8 

•12*4 

5 

11 

84 

346 

3 

5l 

0 

1213^8 

>3f7* 

6 

12 

93 

356 

3 

5l 

3 

I?l3c8 

►  3?25 

7 

13 

79 

3M 

3 

101 

3 

121308 

■4087 

3 

1* 

74 

336 

3 

5l 

3 

121308 

.5397 

9 

15 

80 

342 

3 

101 

-3 

1213qS 

-5677 

10 

16 

76 

338 

3 

51 

-3 

L213C.8 

>6o78 

11 

17 

89 

351 

3 

51 

2 

2l3C8 

•6218 

12 

1« 

38 

2*0 

2 

101 

6 

L21310 

.6457 

13 

19 

31 

221 

2 

101 

6 

121310 

.6545 

1* 

20 

83 

345 

3 

151 

-3 

L21308 

.7075 

15 

21 

77 

339 

3 

5l 

-6  ' 

L21308 

.7943 

16 

22 

88 

350 

3 

51 

2 

12130* 

-8310 

17 

23 

92 

355 

3 

51 

o  : 

121308 

•9209 

18  . 

2* 

81 

3*3 

3 

151 

o  : 

L21308 

.9360 

19 

25 

72 

334 

3 

51 

o  : 

121308 

9540 

20 

26 

78 

340 

3 

101 

o  : 

21308 

-9840 

21 

27 

73 

335 

3 

51 

o  ; 

t?l3c8 

1- 

0360 

22 

28 

8 

105 

1 

101 

-6  ' 

21310 

1< 

>0962 

23 

29 

85 

347 

3 

51 

o  : 

121308 

1« 

•1141 

2* 

30 

86 

348 

3 

51 

0  ' 

121308 

1< 

•  1923 

25 

31 

87 

349 

3 

51 

o  : 

121308 

1« 

•2102 

26 

32 

5 

101 

1 

101 

0  ' 

121310 

1  « 

.3927 

27 

33 

99 

99 

1 

101 

0  ' 

121903 

1  « 

.5511 

28 

34 

2 

99 

1 

101 

0  ' 

121310 

1- 

•  5578 

29 

35 

100 

995 

1 

101 

0  ' 

121903 

1< 

.8137 

30 

36 

3 

995 

1 

101 

0  ' 

L21310 

1< 

-8175 

31 

37 

7 

104 

1 

101 

-3 

121310 

1' 

•  8483 

32 

38 

4 

100 

1 

101 

o  : 

121310 

1< 

8842 

33 

39 

101 

300 

1 

101 

0  3 

1219C3 

1< 

8879 

3* 

40 

6 

102 

1 

101 

3  3 

.21310 

1< 

9201 

35 

41 

105 

205 

5 

101 

0  3 

21903 

3 

2< 

0070 

1 

42 

20 

205 

5 

101 

0  3 

.21310 

3 

2< 

0172 

2 

43 

23 

208 

5 

101 

0  3 

21310 

3 

?« 

0443 

3 

44 

32 

222 

2 

101 

-3  3 

,21310 

1 

2< 

0530 

36 

45 

22 

207 

5 

101 

0  3 

.21310 

3 

2« 

0899 

4 

46 

112 

217 

2 

101 

0  3 

219C4 

2« 

0959 

37 

47 

39 

2*1 

2 

101 

-3  3 

.21310 

2« 

1100 

33 

48 

27 

217 

2 

101 

0  3 

.21310 

2t 

17*0 

39 

49 

37 

239 

2 

101 

3  3 

21310 

2« 

1856 

40 

50 

24 

212 

5 

101 

•6  1 

121310 

3 

2« 

2129 

5 

51 

30 

220 

2 

101 

3  I 

121310 

2« 

2549 

41 

52 

115 

220 

2 

101 

3  ' 

121904 

2« 

2817 

42 

53 

26 

216 

2 

101 

0  ' 

121310 

2« 

2957 

43 
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TABLE  42.     TRADEOFF  LISTING  FOR  BUS  CLASSIFIER 
DESIGN  (CONCLUDED) 


54  102 

101 

1 

101 

0  • 

2l9r3 

1 

2.3682 

44 

55  113 

218 

2 

101 

0 

?l9-4 

1 

?«3764 

45 

56  111 

?16 

2 

101 

0  ' 

?19o4 

1 

?o39<*9 

46 

57   11 

157 

8 

101 

0  3 

2l9r3 

3 

2»4?35 

6 

58   28 

?18 

2 

101 

o  : 

21310 

1 

2.4760 

47 

59   35 

237 

2 

101 

0  1 

21310 

1 

2«5«37 

48 

60   29 

219 

2 

101 

0  1 

21310 

1 

?«6377 

49 

61   12 

158 

8 

1C1 

0  1 

219-3 

3 

2.6482 

7 

62  11* 

219 

2 

101 

0  1 

?l9-4 

1 

2.6^-08 

5.0 

63   36 

238 

2 

101 

0  1 

2i3i: 

1 

P. 6^6 7 

5; 

64    9 

148 

9 

101 

0  3 

.219-3 

3 

2«6705 

£ 

65   44 

250 

7 

1C1 

6  ] 

?  1  3 1  '■■ 

4 

3.1-82 

1 

66  lc6 

254 

7 

102 

C  ' 

2l9f3 

4 

3*2-65 

? 

67   43 

247 

7 

101 

i*\   < 

121310 

4 

3«3-*82 

1 

68   10 

149 

9 

101 

C  1 

21  9,-4 

3 

3*3681 

3 

69   16 

167 

4 

101 

3  1 

2131C 

2 

3.3694 

1 

70  117 

246 

7 

1  oi 

0  3 

219-4 

4 

3.3716 

4 

71   95 

358 

13 

51 

213:8 

C 

3.47,40 

6 

72   41 

245 

7 

101 

0 

21  9c  4 

4 

3«4407 

r. 

73   97 

246 

7 

1C1 

C  3 

.21310 

4 

"3.5644 

A 

74   53 

274 

16 

52 

4  1 

21310 

0 

3.6009 

7 

75   65 

3C0 

16 

51 

4  1 

.?l9v-4 

r\ 

3.6260 

8 

76   18 

170 

4 

101 

-4  1 

21310 

2 

3.6307 

? 

77   62 

295 

16 

51 

L 

213m 

- 

3.6522 

9 

78   19 

171 

4 

101 

•6  1 

21310 

2 

3.6718 

3 

79  118 

250 

7 

101 

6  3 

?l9-4 

4 

3»73?7 

7 

80   45 

251 

7 

101 

6  1 

2l9;<4 

4 

3.8322 

a 

81   98 

247 

7 

101 

\J        J 

21310 

4 

3. 8330 

1 

82   14 

165 

4 

101 

0  1 

2l9o3 

2 

3*9?43 

4 

83   21 

2q6 

5 

101 

Kj        1 

?l9r3 

3 

4=oi86 

10 

84   46 

254 

7 

102 

0  1 

21310 

4 

4,  o840 

10 

85   15 

166 

4 

101 

C  1 

2l9o3 

2 

4.1543 

5 

86   25 

213 

5 

101 

C  1 

2l9c4 

3 

4.1739 

H 

87   71 

317 

6 

l5l 

3  1 

2l9c4 

3 

4.2412 

■2 

88   7Q 

316 

6 

151 

o  : 

21310 

3 

4.2563 

13 

89   69 

312 

6 

51 

C  1 

2131C 

3 

4  .2597 

I4 

90   57 

278 

16 

52 

-4  l 

.2131C 

'} 

4  .2644 

10 

91   61 

2S9 

6 

101 

3  1 

21310 

3 

4.?»99 

;5 

92   68 

3o7 

6 

21 

3  ] 

?l9r4 

3 

4.  ?9?4 

16 

93   48 

264 

6 

102 

3  ] 

L21310 

3 

4. 3640 

l? 

94   42 

246 

7 

101 

C  3 

21310 

4 

4,3905 

11 

95  i07 

262 

6 

102 

.1 

?l9C3 

3 

4. 4^00 

,8 

96   13 

1645 

4 

101 

0  3 

?1903 

2 

4.5594 

6 

97   17 

169 

4 

101 

"3    ] 

2l3io 

2 

4.6480 

7 

98  103 

169 

4 

101 

-3  i 

2l903 

r> 

4.7p07 

a 

99   52 

273 

16 

52 

2  1 

21310 

<* 

4  .7743 

11 

100  110 

273 

16 

52 

2  3 

2l9c3 

o 

5.0^32 

12 

101  119 

262 

6 

102 

0  3 

?19C* 

3 

5  •  1 4  5  5 

.9 

X 

102   *7 

262 

6 

102 

j 

21310 

3 

5»  1505 

?0 

103   66 

3Q4 

16 

51 

=  4  1 

2l9o4 

C 

5.6748 

13 

10*   *0 

243 

12 

101 

0  3 

21310 

\J 

6.1J7C 

14 

105   54 

275 

16 

52 

4  1 

2l9c^ 

r. 

6.7705 

15 

106   56 

277 

16 

52 

•2  3 

2131C 

0 

6.8841 

16 

107   63 

296 

16 

51 

C  ' 

21310 

V 

7*0360. 

17 

1Q8  1o9 

271 

16 

52 

0  3 

.2l9C3 

0 

7.0a55 

18 

109  121 

274 

16 

52 

4  3 

21904 

o 

7.4104 

19 

110  120 

271 

16 

52 

0  3 

21904 

0 

7.5629 

20 

HI   55 

276 

16 

52 

•2  : 

21310 

o 

7.6973 

?1 

112   49 

270 

16 

52 

0  3 

21310 

i»i 

7.g-?3 

22 

113  108 

2?0 

16 

52 

C  1 

2l9c3 

7*9527 

'3 

114   50 

271 

16 

52 

0  3 

.21310 

c 

8.0455 

24 

115   51 

272 

16 

52 

2  : 

L21310 

0 

8.2939 

25 

116   33 

224 

12 

101 

C  3 

21310 

0 

11*6656 

26 

117   59 

281 

16 

52 

0  ' 

121310 

0 

15.Q12* 

27 

118   60 

283 

16 

52 

-2  3 

121310 

0 

15.5583 

28 

119   58 

2So 

16 

52 

0  ' 

121310 

0 

15.7680 

29 

120  104 

0 

10 

0 

o  : 

L21903 

5 

20*0684 

121    1 

0 

10 

0 

0 

L2l9o3 

5 

101*7179 
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-0.14 


5.465 


t':* 


Figure  27.     Joint  Plot  of  Stopped  Vehicle  Discriminant  Values 

The  stopped  vehicle  discriminants  were  found  using  the  CTC  program.     A 
run  was  made  using  the  method  1  classifier  on  secondary  features  three  and 
four.     Five  classes  were  assigned  vehicle  types  as  follows: 


Class  1:  Types  1,   2,    3  (3  bus  types)  (moving) 

Class  2:  Type  4  (semi- trailer)  (moving) 

Class  3:  Type  5  (truck)  (moving) 

Class  4:  Type  6  (step  van)  (moving) 

Class  5:  Type  7  (moving  van)  (moving) 

Class  0:  All  others  (moving  and  stopped) 


Each  class  was  assigned  an  a-priori  probability  of  0.  20,   except  class  0  which 
is  assigned  zero  probability.     The  method  1  classifier  calculated  discrimi- 
nants for  all  class  pairs;  the  tradeoff  of  scores  for  the  class  1  versus  class  3 
discriminant  is  shown  in  Table  43.     Two  thresholds  along  this  discriminant 
were  selected,    one  at  a  score  value  of  -0.  1408  and  another  at  a  score  value 
of  2.  399.     These  thresholds  were  chosen  because  all  class  1  feature  vectors 
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TABLE  43.     TRADEOFF  LISTING  FOR  BUS  CLASSIFIER 
DESIGN 


OATE 

1223  ID 

90  RUN2B 

TRADE8FF  F9R 

Pair 

1   3 

C8EFF 

6« 

32919 

-.00273 

•00CF8 

N6 

ID 

TY 

CL 

5C8RE 

0   12   3   4b 

1 

64 

298 

16 

51 

2  : 

121310   0 

-10.0128 

1 

2 

46 

254 

7 

102 

o  : 

21310   5 

-2*0326 

1 

3 

97 

246 

7 

101 

0  3 

21310   5 

-1  .7768 

2 

4 

98 

247 

7 

101 

0  3 

21310   5 

-1.3142 

3 

5 

'  44 

250 

7 

1C1 

6  1 

21310   5 

-.8579 

4 

6 

45 

251 

7 

1C1 

6  3 

2l9;^4   5 

-»3781 

6 

7 

82 

344 

3 

151 

3  3 

21308   1 

•  0929 

1 

8 

32 

222 

2 

101 

-3  1 

21310   1 

•260* 

2 

9 

94 

357 

3 

51 

-3  3 

2l308   1 

•2643 

3 

10 

33 

??** 

12 

101 

o  : 

21310   C 

•  36  «6 

2 

11 

39 

241 

2 

101 

•3  3 

21310   1 

.4885 

<+ 

12 

90 

352 

3 

51 

4  ' 

I2j3r,8   i 

•  5^84 

5 

13 

79 

341 

3 

101 

3  3 

2l3r8   i 

•  5*23 

6 

1* 

74 

336 

3 

51 

3  3 

213C8   1 

•6561 

7 

15 

84 

346 

3 

51 

0  3 

2l3cS   1 

•  6563 

8 

16 

89 

351 

3 

51 

2  3 

213CB   1 

.7-64 

9 

17 

92 

355 

3 

51 

0  3 

213C8   l 

•  7788 

10 

18 

72 

334 

3 

51 

0  3 

1213C8   i 

•  8l63 

11 

19 

75 

337 

3 

51 

6  ' 

I2l3c8   l 

•  8280 

12 

20 

81 

343 

3 

151 

C  3 

2l3p8   i 

•  8702 

13 

21 

88 

350 

3 

51 

2  3 

1213C8   i 

•  9748 

1* 

22 

27 

217 

2 

101 

0  ' 

21310   1 

•  9802 

15 

23 

86 

348 

3 

51 

0  ' 

121308   l 

•  9858 

16 

24 

78 

340 

3 

101 

0  3 

21308   1 

•9983 

17 

25 

73 

335 

3 

51 

0  3 

21308   1 

1*0001 

18 

26 

80 

342 

3 

101 

-3  J 

121308   1 

1.0090 

19 

27 

76 

338 

3 

51 

•3  ' 

21308   l 

1-0134 

20 

28 

85 

347 

3 

51 

C  3 

L  2 1 3  C  B   1 

1  •0«93 

21 

29 

26 

216 

2 

101 

0 

121310   1 

1  «0906 

22 

30 

83 

345 

3 

151 

-3 

L21308   l 

L1091 

23 

31 

2 

99 

1 

101 

C 

121310   1 

1*2003 

24 

32 

99 

99 

1 

101 

0  ' 

L21903   1 

l»2o3C 

25 

33 

87 

349 

3 

51 

0 

121308   1 

l»2l86 

26 

34 

38 

240 

2 

101 

6 

121310   1 

1  «3-,85 

27 

35 

95 

358 

13 

51 

0  ' 

L21308   o 

1-3247 

3 

36 

31 

221 

2 

101 

6 

121310   1 

1.3340 

28 

37 

5 

101 

1 

101 

0 

121310   1 

1*3473 

29 

38 

93 

356 

3 

51 

3  ' 

L21308   i 

1*3600 

30 

39 

91 

353 

3 

51 

-2  ' 

1213C8   i 

1.3732 

31 

40 

96 

359 

13 

51 

G 

121 308   c 

1  .44  80 

4 

41 

6 

102 

1 

101 

3  ' 

12131C   1 

1  .4495 

32 

42 

35 

237 

2 

101 

0 

21310   1 

1  .4659 

33 

43 

28 

218 

2 

101 

0 

L21310   1 

1.4918 

3* 

44 

29 

219 

2 

101 

0 

213 10   1 

1  .5-88 

35 

45 

36 

238 

2 

101 

C  ' 

121310   1 

1-5196 

36 

46 

100 

995 

1 

101 

0 

I2l9r3   i 

1*55?2 

37 

47 

7 

10* 

1 

101 

-3 

L21310   i 

1»5600 

33 

48 

3 

995 

1 

101 

0 

121310   1 

1.5638 

39 

49 

4 

100 

1 

101 

0 

[21310   1 

1*6006 

40 

50 

77 

339 

3 

51 

=  6 

L21308   i 

1*6159 

41 

51 

37 

239 

2 

101 

3 

2131C   1 

1  .7848 

42 

52 

30 

220 

2 

101 

3 

121310   1 

l*8cl6 

43 

53 

8 

«  ",5 

1 

101 

-6 

121310   1 

l«9i37 

44 

213 


TABLE  43,     TRADEOFF  LISTING  FOR  BUS  CLASSIFIER 
DESIGN  (CONCLUDED) 


54 
55 
56 
57 
58 
59 
60 
61 
62 
63 
64 
65 
66 


69 

70 
71 
72 
73 
74 
75 
76 
77 
78 
79 
80 
81 
82 
83 
84 
85 
86 
87 
88 
89 
30 
91 
92 
93 
94 
95 
96 
97 
98 
99 
100 


34 
40 
58 
67 
59 
66 
10 
65 
25 
24 
55 
9 
47 


67  52 

68  62 


56 

51 

21 

11 

20 

12 

60 

22 

63 

23 

71 

69 

70 

50 
53 

54 

61 
68 
43 
41 
42 
57 

1 

48 
49 
13 
16 
19 
14 
18 
15 
17 


??5 
243 
2S0 
3q5 

251 
30  4 
149 

300 

213 

2l2 
276 
148 
262 
273 
295 
277 
272 

157 
205 
158 
283 

20? 
296 

20® 
317 

312 

316 
271 
274 
275 
289 

30? 
247 
245 
246 
278 

0 
264 

270 
1645 
167 
171 
165 
170 
166 
169 


12 

12 
16 
16 

16 

16 

9 

16 

5 
5 

16 
9 
6 

16 

16 

16 

16 
5 
8 
5 
8 

16 
5 

16 
5 
6 
6 
6 

16 

16 

16 
6 
6 
7 
7 
7 
16 

10 

6 
16 

4 

4 

4 

4 

4 

4 

4 


101 

101 

52 

51 
52 
51 

101 
51 

101 

101 

5? 

101 

102 

52 

51 

52 

52 

101 

101 

101 

101 

52 

101 
51 

101 
,151 

51 
151 

52 
52 

52 

101 

21 

101 
101 
101 

52 

0 

102 

5a 

101 
101 
101 
101 
101 
101 
101 


0  121310 

0 

1*9?68   5 

0  121310 

0 

2.H42   6 

0  121310 

0 

2*6955   7 

•4  121904 

0 

2.7J22   8 

C  121310 

0 

2*71*1   9 

^4  l'2l9o4 

2*7325  10 

C  12190^ 

0 

2*7340  H 

4  I2l9n4 

L 

2*7368  i2 

0  I2l9r4 

3 

2*7383            i 

•6  121310 

3 

'  P. 7544            p 

"2  12131C 

0 

2*7763  i3 

0  12l9o3 

0 

2*7775  ik 

0  121310 

4 

2-7910 

2  121310 

o 

2* 7990  15 

0  121310 

0 

2*8'>42  16 

•2  121310 

0 

2«8l40  17 

2  121310 

0 

2*8349  18 

0  I2l9r3 

3 

2*8960            3 

0  121903 

0 

2*9224  1.9 

0  121310 

3 

,    2*9400           4 

0  121 903 

0 

2*9546  20 

•2  121310 

0 

2*9768  2i 

0  121310 

3 

2*9985           5 

0  121310 

0 

3*0000  22 

0  121310 

3 

3*0032           6 

3  I2l9r4 

4 

3*0805 

0  1P1310 

4 

3«0922 

0  121310 

4 

3*0958 

0  121310 

0 

3*li99  23 

4  121310 

0 

3*1321  24 

4  l?l904 

0 

3*1350  25 

3  121310 

4 

3*140? 

3  1219Q4 

4 

3*1453 

0  121310 

5 

3*1546 

0  !2l9o^ 

5 

3*1549 

0  121310 

5 

3*2ol8 

-4  i?i3lo 

0 

3*20^0  26 

C  121903 

0 

3*2416  27 

3  121310 

4 

3*2984 

0  121310 

0 

3*5542  28 

0  121903 

2 

3*8761         i 

3  121310 

2 

3*9q02        2 

"6  121310 

2 

4*0106        3 

0  12l9o3 

2 

4*0158         4 

"4  121310 

2 

4*0324         5 

0  121903 

2 

4*1382        6 

•3  121310 

2 

4*2809         7 

2 

3 
4 


5 

6 
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lie  between  them,   and  all  other  feature  vectors  lie  outside  them  (except 
for  several  class  0  vectors,   which  are  of  types  12  and  13,   namely  stopped 
busses).     A  logical  variable  was  defined  as  true  for  scores  greater  than 
2.  399  and  false  otherwise,   and  a  second  logical  variable  was  defined  as 
true  for  scores  greater  than  -0.  1408  and  false  otherwise.     These  two  logical 
variables  could  be  used  alone  since  they  discriminate  the  range  of  scores 
associated  with  class  1  (buses),   but  two  more  logical  variables  were  defined 
instead  as  additional  selection  criteria. 

These  last  two  logical  variables  were  selected  from  the  discriminant  be- 
tween class  2  and  class  3,   shown  in  Table  44.     While  it  may  appear  thought- 
less to  use  the  boundary  (discriminant)  between  classes  2  and  3  (semis  and 
trucks,   respectively)  to  detect  a  class  1  vehicle  (bus),   examining  the  scores 
reveals  that  all  class  1  vectors  lie  between  two  limits  -  3.  465  and  5.  465. 
Also  the  only  other  vectors  in  this  range  are  from  class  0  and  are,    in  fact, 
non-moving  busses.     The  two  thresholds  were  used  and  logical  variables 
were  defined  -  one  being  true  only  for  scores  greater  than  3.465  and  the 
other  being  true  for  scores  greater  than  5.  465.     When  the  first  is  true  and 
the  second  is  false,   then  a  bus  is  detected. 


DECIDING  WHETHER  A  VEHICLE  IS  STOPPED  OR  MOVING 

The  decision  rules  for  stopped  and  for  moving  vehicles  could  be  determined 
independent  of  the  method  used  to  decide  whether  a  vehicle  was  a  stopped 
vehicle  or  a  moving  vehicle.     However,    the  decision  has  to  be  based  upon 
the  primary  or  secondary  features  if  it  is  to  be  included  in  the  bus  classifier 
algorithm. 

If  a  vehicle  stops  while  crossing  the  loop,    then  one  or  more  of  the  primary 
time  features  T0,    T.. ,    T~,    TT    will  become  large  (see  Figure  16).     The 
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TABLE  44.     TRADEOFF  LISTING  FOR  BUS  CLASSIFIER 
DESIGN 


->ATE 

1223  ID 

BD  RUNE 

'6 

TRADtQFF  F9R 

PAIR 

?   3 

ceEFF 

e 

46471 

•0025c 

> 

•0001 

* 

N6 

ID 

TY 

CL 

l 

17 

169 

* 

101 

-3  1 

2131C 

2 

2 

18 

170 

4 

101 

•4  : 

21310 

2 

3 

15 

166 

4 

101 

o  < 

2l9o3 

2 

4 

19 

171 

4 

101 

•6  1 

21310 

2 

5 

14 

165 

4 

101 

C  ' 

25  90 3 

2 

6 

16 

167 

4 

101 

3  : 

21310 

?. 

7 

13 

16*5 

4 

101 

c  : 

219C3 

2 

8 

42 

?46 

7 

101 

C  3 

121310 

5 

9 

43 

?47 

7 

101 

c  : 

21310 

5 

10 

41 

2*5 

7 

101 

o  : 

l?l9o4 

5 

11 

49 

270 

16 

5g 

C  ' 

.21310 

C 

12 

57 

?78 

16 

52 

•*  : 

21310 

r 

13 

48 

?«>4 

6 

102 

3  3 

21  310 

h 

1* 

1 

0 

10 

c 

c  : 

1219?3 

C 

15 

23 

208 

5 

101 

0  ' 

121310 

3 

16 

22 

"37 

5 

101 

r\ 

21310 

3 

17 

20 

20  5 

5 

101 

o  : 

121310 

3 

18 

12 

158 

8 

101 

o 

121903 

r 

19 

68 

307 

6 

21 

3  : 

L2190* 

* 

20 

61 

289 

6 

101 

3  I 

12131C 

4 

21 

11 

157 

8 

101 

0  ' 

121903 

22 

70 

316 

6 

151 

c  : 

121310 

* 

23 

53 

274 

16 

52 

4  3 

21310 

■J 

24 

69 

312 

6 

51 

o  1 

121310 

4 

25 

71 

317 

6 

151 

3  5 

121904 

4 

26 

21 

206 

5 

101 

0  1 

121903 

3 

27 

54 

275 

16 

52 

4  : 

1219Q4 

0 

28 

63 

296 

16 

51 

o  : 

121310 

0 

29 

66 

304 

16 

51 

-4  ' 

121904 

0 

30 

67 

3c5 

16 

51 

-4 

12190^ 

c 

31 

24 

212 

5 

101 

-6  ' 

121310 

3 

32 

9 

5*8 

9 

101 

o  : 

219C3 

0 

33 

60 

283 

16 

52 

-2  ' 

121310 

0 

3* 

65 

300 

16 

51 

4  ' 

1219C-4 

c 

35 

25 

213 

5 

101 

0  ' 

121904 

3 

36 

10 

149 

9 

101 

0  ' 

121904 

0 

37 

62 

295 

16 

51 

o  : 

121310 

0 

38 

51 

272 

16 

52 

2  : 

121310 

0 

39 

56 

277 

16 

52 

•2  : 

121310 

0 

40 

50 

271 

16 

52 

0  3 

121310 

o 

41 

52 

273 

16 

52 

2  3 

121310 

0 

42 

55 

276 

16 

52 

•2  3 

121310 

0 

43 

47 

262 

6 

1C2 

0  3 

21310 

4 

44 

59 

281 

16 

52 

0  3 

121310 

0 

45 

58 

280 

16 

52 

0  3 

121310 

c 

46 

40 

243 

12 

101 

C  1 

121310 

0 

47 

8 

105 

1 

101 

-6  1 

121310 

1 

48 

77 

339 

3 

51 

•6  3 

121308 

1 

49 

34 

225 

12 

101 

0  3 

121310 

0 

50 

30 

220 

2 

101 

3  3 

121310 

1 

51 

37 

239 

2 

101 

3  1 

,21310 

1 

52 

91 

353 

3 

51 

•2  3 

213C8 

1 

53 

93 

356 

3 

51 

3  3 

?13o8 

'  1 

c 

}Rr 

0   1 

2 

1 

•  8988 

1 

1 

.9717 

2 

1 

.9758 

3 

1 

.9919 

4 

? 

>0?86 

5 

■? 

•0658 

6 

p 

»1»»6 

7 

2 

•  5379 

p 

»5»09 

p 

•  5934 

? 

•  6365 

1 

2 

•  7707 

2 

2 

•  8?53 

?. 

•  8699 

3 

? 

•  8764 

? 

•  8834 

2 

•9261 

? 

•9301 

4 

2 

•  9395 

P 

•  9*44 

? 

•  9686 

5 

? 

•  9766 

? 

•9791 

6 

2 

-9792 

2 

.9873 

2 

-9937 

3 

.0100 

7 

3 

•  0544 

8 

3 

•  0698 

9 

3 

•  0772 

10 

3 

•  0851 

3 

•  0918 

11 

3 

•1207 

12 

3 

•1254 

13 

3 

•1315 

3 

•  1*68 

1* 

3 

•  2421 

15 

3 

'2539 

16 

3 

.2552 

17 

3 

.2713 

18 

3 

.2784 

19 

3 

>2799 

2; 

3 

.2818 

3 

.3539 

21 

3 

.3721 

22 

3 

.5563 

23 

3« 

.5715 

1 

3> 

.7127 

2 

3- 

•  7156 

24 

3< 

>7709 

3 

3< 

.7778 

4 

3. 

8286 

5 

3- 

-8870 

6 
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TABLE  44.     TRADEOFF  LISTING  FOR  BUS  CLASSIFIER 
DESIGN  (CONCLUDED) 


5* 

4 

100 

1 

101 

0 

12131C 

1 

"5  .88.85 

7 

55 

96 

359 

13 

51 

0 

121308 

C 

3»9oOc  ?5 

56 
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995 

1 

101 

c 

121310 

1 

3,»9'l'31 

8 

57 

7 

10* 
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-3 

121310 
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3»9?0G 

9 

58 

31 

221 

2 

101 

6 

121310 

1 

■3.9??5 

10 

59 

100 

995 

1 

101 

0 

I2l9r3 

1 

3<9?36 

11 

60 

38 

24Q 

2 
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6 

121310 

1 

3»9453 

1? 

61 

95 

358 

13 

51 

0 

121 3q8 

r 

3-9887  ?fe 

62 

6 
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1 
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3 

I?l3l~ 

1 

3 • 9960 

13 

63 

36 

238 

2 

101 

0 

121310 

1 

4.q559 

14 

64 

28 

218 

2 

101 

0 

121310 

1 

4.^561 

15 

65 

29 

219 

2 

1C1 

0 

1?1310 

1 

4.-A38 

16 

66 

5 

id 

1 

101 

c 

121310 

1 

4 • -790 

17 

67 

35 

237 

2 
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c 

121310 

1 

4«o895 

19 

68 

87 
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3 

51 

c 

1213.-8 

1 

4.1-16 

19 

69 

83 

345 

3 

l5j 

B»  3 

125  3-8 

1 

4"ll9c 

2- 

70 

99 

99 

1 

lC'l 

'■J 

123  9-3 

1 

4*1730 

21 

71 

2 

99 

1 

101 

0 

121310 

3 

4.1755 

22 

72 

76 

338 

3 

51 

»3 

121308 
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4»1780 

23 

73 

80 

342 

3 

101 

"3 

121308 

1 

4*1787 

24 

74 

85 

347 

3 

51 

Q 

1P13C-8 

1 

4  •  | Hg9 

25 

75 

75 

337 

3 

51 

6 

I2l3c8 

1 

4.2o33 

26 

76 

88 

350 

3 

5j 

2 

I?l3r.8 

1 

4»2405 

27 

77 

73 

335 

3 

5l 

121 3CB 

1 

4  .2553 

g8 

78 

78 

34Q 

3 

301 

0 

121308 

1 

4»?577 

29 

79 

86 

348 

3 

51 

0 

12l3c8 

1 

4  «2E26 

30 

80 

81 

3^3 

3 

l5i 

-  0 

I2l3r8 

4 

4.3386 

31 

81 

72 

334 

3 

51 

n 

I2l3c8 

3 

4.3931 

32 

82 

89 

351 

3 

51 

2 

I2l3c8 

1 

4^4210 

33 

83 

92 

355 

3 

51 

C 

l?l3-8 

1 

4.4324 

34 

84 

84 

346 

3 

5l 

0 

121  3.0? 

1 

4.4331 

35 

85 

26 

2l6 

2 

101 

0 

121310 

I 

4.4351 

36 

86 

74 

336 

3 

51 

3 

I2l3c8 

1 

4.4561 

37 

87 

90 

352 

3 

5l 

4 

121  3c-8 

1 

4 .4^66 

38 

38 

79 

34| 

3 

101 

3 

I?l3r8 

I 

4.5o86 

39 

89 

27 

217 

? 

101 

0 

121310 

1 

4.5090 

40 

90 

94 

357 

3 

51 

.3 

1213-8 

I 

4.6562 

41 

91 

82 

344 

3 

l5l 

3 

1?1308 

1 

4.7«78 

4? 

92 

39 

241 

2 

101 

-3 

121310 

1 

4.3920 

43 

93 

33 

224 

12 

101 

0 

121310 

r 

4.9653  ■>! 

94 

32 

222 

? 

101 

03 

I2l3ic 

1 

5.06^0 

44 

95 

45 

251 

7 

101 

6 

1219C4 

5 

5.8481 

96 

44 

250 

7 

101 

6 

121310 

5 

6*1081 

97 

98 

247 

7 

101 

0 

1?131C 

5 

6.7130 

98 

97 

246 

7 

101 

0 

121310 

5 

7.1415 

99 

46 

254 

7 

102 

0 

121310 

c 

7.4o34 

100 

64 

298 

16 

51 

2 

221310 

r, 

I3sps?35  28 
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T  T    +TS 

normalized  time  features  Ei     =    tf — ■   m     and  E„    =   7= — -  ^     will  behave  in 

1  T0  +  TL  2  T0  +  TL 

distinctive  ways  that  depend  on  which  of  the  times  T.  is  large.     Thus,   if  TT 

becomes  very  large,    then  both  E1  and  E„  will  become  small.     The  other 

possibilities  are: 


Large  Time  Valu 

e                E1 

_E2_ 

To 

Large 

Small 

Tl 



Large 

Ts 



Large 

TL 

Small 

Small 

Thus,  we  should  expect  moving  vehicles  to  have  small  values  of  E?  and 
intermediate  values  for  E1 . 

Study  of  the  distribution  of  E-  and  E„  for  the  experimental  data  led  to  defin- 
ing small  E2  as  E2  <  2.  4  and  intermediate  E-  as  0.  43  £  Ex  <  0.  70. 

To  determine  a  decision  rule  based  on  the  experimental  data,  define  two 
logical  variables  L1 ,    L?  where 

L     is  true  when  0.  43  <:  E.  <  0.  70 
L2  is  true  when  2.  5  ^  E2. 

The  values  (true  or  false)  of  L1  and  L2  determined  from  the  test  data  are: 


Ll  = 

T 

T 

F 

F 

L2    ■ 

T 

F 

F 

T 

Number  of 
Moving  Vehicles 

7 

79 

3 

0 

Number  of 
Stopped  Vehicles 

16 

2 

8 

0 
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Thus,    it  is  clear  that  L-  true  and  L„  false  is  the  condition  to  use  for  de- 
ciding that  a  vehicle  was  moving. 

It  was  found  that  certain  moving  vehicles  were  more  easily  classified  by  the 
stopped  vehicle  classifier.  Study  of  the  signal  recordings  and  logs  revealed 
that  these  vehicles  had  been  accelerating  or  decelerating  as  they  crossed  the 
loop.     The  thresholds  were  then  adjusted  and  the  two  final  vehicle  divisions 
are  more  appropriately  called  uniformly  and  nonuniformly  moving  vehicles. 


TESTING  THE  COMPLETE  CLASSIFIER 

The  output  obtained  using  the  logical  mode  classifier  with  the  two  logical  vari- 
ables to  classify  moving  vehicles  and  the  three  logical  variables  to  distinguish 
between  uniformly  moving  and  non-uniformly  moving  vehicles  discussed  above 
is  shown  in  Table  45.     All  moving  busses  (class  1)  have  scores  equal  to  20 
(octal),   and  all  other  vehicles  have  scores  not  equal  to  20.     Thus  a  bus  is 
detected  for  any  feature  vector  input  to  the  classifier  which  produces  an  out- 
put score  equal  to  20. 

A  final  run  was  made  using  the  logical  mode  classifier  with  all  nine  logical 
variables.     Five  of  these  were  the  same  as  those  used  in  the  previously  dis- 
cussed logical  mode  execution,  and  the  other  four  were  those  determined 
from  discriminant  scoring  values  obtained  from  the  method  1  classifier  as 
classifying  non-uniformly  moving  vehicles.     These  nine  logical  variables 
were  used  in  an  execution  of  the  logical  mode  classifier;  the  output  is  shown 
in  Table  46,     In  this  case  there  are  two  scores  which  must  be  detected  to 
indicate  a  bus      A  score  of  400  has  been  assigned  to  one  event,   while  all 
other  busses  are  scored  at  412,     Table  47  summarizes  the  results  obtained 
using  the  CTC  program.     Figure  28  is  a  functional  diagram  of  the  complete 
bus  detector  from  sensor  (the  buried  loop)  to  final  classification  (bus  or  not 
bus). 
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TABLE  47.     BUS  CLASSIFIER  DECISION  ALGORITHM 


L- ,  .  .  . 

,   EL  are  the  logical  variables  defined 

in  the 

preceding 

discussions. 

Stopped 

Vehicle  Test 

Li 

true  when  430  £  Sc  <  700 
b 

L2 

true  when  2500  £  S? 

A  non-s 

topped  vehicle  is  indicated  when  L-  is 

true  and  L2  is  false. 

Moving 

Vehicle  Classifier 

Kl 

true  when 

-0.  277  S1  +  0.  0198  S2  +  0.  228  S3  -  0. 

947  S4 

:>  -L01 

K2 

true  when 

-1.  86  S1  +  1.  36  S2  +  2.  17  S3  -  4.  10  S 

4*-l 

944 

A  "bus" 

is  indicated  when  K-  is  false  and  K„  is  false 

;  otherwise  a  "non- 

■bus" 

is  indicated. 

Stopped  Vehicle  Classifier 

Hl 

is  true  when 

3,  93  £  2.  73  S3  +  0.  876  S4  £  6,  47 

H2 

is  true  when 

3.  00  ^  2.  52  S3  +  0.  139  S4  £  5.  00 

A  "bus" 

is  indicated  when  EL  is  true  and  EL  is 

true; 

otherwise, 

the  ' 

vehicle 

is  a  "non-bus". 

__ 

224 


o 


o     o 

sis 


a: 

h- 
< 


o 

UJ 
O 


*~ 


Ul 


to 

C3 


o 


o 

UJLLl 


in 

o-u. 


Till 


(/) 

t~-tO 

3 

03 

CO 

ZCQ 

< 
Z 
LU 

'  YES  = 
VEHIC 
PAST 

f  P-  \ 
CM  \ 

\ 

/i    / 

< 
o 

>± 

to 

to 

o 


OOtO 

(3QI- 


QIH- 
ZLULJ 
Ljd>0 


< 
> 

o 


cacc 


O 
+-> 
o 

<D 
-t~> 

Q 

CO 

G 
PQ 
<y 


«3 

two 

cd 

•r-t 

Q 


g 
o 

•  »-< 
+-> 

o 

G 
P 


CO 
CM 

0> 
Pi 


225 


Subsequent  to  the  initial  classifier  design,  additional  experimental  data 
were  obtained  from  the  FHWA  facility  in  Washington,   D.  C.  ,   plus  recordings 
of  street  traffic  in  Washington,   D.  C.     This  data,   plus  the  original  data, 
were  all  processed,  using  the  full  classifier  and,  after  minor  changes  to 
threshold  values,   the  classifier  correctly  identified  all  signals  with  the 
exception  of  three  questionable  recordings. 


Areas  of  Potential  Concern 

Classifier  Coefficients  —  Geometrically  speaking,   the  classifier  coefficients 
describe  the  location  and  normal  direction  of  planes  that  separate  the  bus 
feature  values  from  the  non-bus  feature  values.     The  feature  values  are 
calculated  from  measured  peak  times  and  amplitudes.     These,    in  turn,  de- 
pend upon  the  vehicle  detection  threshold,   the  peak  tolerance  value  and  the 
bias  estimating  filter.     These  were  described  in  the  preceding  pages  but 
there  is  a  certain  amount  of  arbitrariness  in  the  whole  procedure. 

The  threshold,   tolerance,  and  bias  estimate  were  defined  and  simulated  and 
experiments  were  performed  (using  recorded  signals)  to  determine  good 
values  for  these  parameters.     Optimization  was  not  possible  because  the  opti- 
mum is  the  set  that  gives  the  best  classification.     Instead,   the  classifier  is 
determined  from  the  somewhat  arbitrary  choice  of  good  values.     Next,   the 
features  were  defined  by  postulating  a  number  of  ways  of  combining  mea- 
surements to  overcome  the  stopped  vehicle,   different  speeds,   displacement 
from  center  line,  and  other  variables  that  were  apparent.     Four  of  the 
candidate  features  were  chosen  because  they  had  good  statistical  properties. 
Again,   the  choice  was  not  a  strict  optimal  one.     Finally,    the  classifier  coeffi- 
cients were  determined  and  the  unpredictable  result  was  perfect  separation. 
This  result  produces  one  more  arbitrary  factor,  because  the  slope  of  the 
planes  can  be  changed  slightly  or  they  can  be  shifted  back  and  forth  a  small 
distance  and  the  classification  is  still  100  percent.     Ideally,   we  should  now 
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return  to  the  starting  point  and  optimize  the  detection  threshold,   the  peak 
tolerance,  and  all  the  other  arbitrarily  chosen  values  so  as  to  produce  the 
best  classifier.     And  as  more  data  become  available  the  loop  should  be  re- 
cycled to  further  improve  the  results.     In  other  words,   the  ideal  design 
process  does  not  end  until  the  optimum  is  realized,  which  may  be  never. 

Thus,  we  must  conclude  that  some  arbitrariness  is  unavoidable  if  we  are  to 
be  practical.     But  we  must  also  decide  whether  the  current  level  of  arbitrari- 
ness is  acceptable.     We  can  only  answer  on  the  basis  of  data,   experience 
and  intuition,  and  the  answer  at  this  time  is  "yes" I     However,  we  may  learn 
otherwise  as  our  data  and  experience  changes!     Fortunately,   the  digital 
implementation  allows  such  changes  to  be  made  relatively  easily,   so  the 
decision  to  accept  current  level  information  is  not  as  critical  as  for  a  hard- 
wired device. 

i 
Vehicle  Detection  Threshold  --  The  threshold  was  chosen  before  the  classi- 
fier structure  and  the  kinds  of  features  were  known.     The  primary  criterion, 
at  that  time,  was  to  detect  all  busses.     A  secondary  criterion  was  to  detect 
enough  other  vehicles  so  that  a  representative  set  of  non-bus  signatures 
could  be  obtained  for  the  classifier  training.     Later  on,   the  threshold  be- 
came important  in  another  way;  it  determines  the  first  and  last  signal  inter- 
vals,  that  in  turn  are  used  to  normalize  the  time  features  to  reduce  their 
dependence  on  vehicle  speed.     After  the  classifier  had  been  simulated,   the 
threshold  was  tested  by  varying  it  over  the  50  percent  to  200  percent  range 
to  see  if  it  was  a  critical  value.     Over  this  range,   it  was  not,   so  the  value 
was  accepted. 

Months  later,  when  analyzing  the  Washington  Street  data  with  a  simulation 
that  now  included  the  quantized  values  of  time,  amplitude  and  bias  correction, 
it  was  seen  that  signal  gain,  quantization,  bias  correction  and  adjacent  lane 
vehicles  can  couple  with  the  threshold  to  produce  errors.     The  effect  can  be 
counteracted  for  the  existing  data  recordings  by  changing  the  stopped  vehicle 
test  from  E„  >  2.  5  to  E~  >  2,  3    This  corrects  the  one  bus  that  experiences 
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this  unique  set  of  conditions  and  does  not  change  the  classification  of  any 
other  vehicle.     (It  should  be  noted  that  this  one  bus  has  been  run  ten  times 
on  the  simulation  using  different  bias  correction  time  constants  and  it  was 
classified  as  a  bus  six  times.     The  fundamental  random  variable  appears 
to  be  the  time  of  day  at  which  the  data  is  sampled!  ) 

The  change  in  the  E„  test  value  is  almost  insignificant,  but  it  shows  a  number 
of  things.     First,   it  is  an  example  of  the  arbitrariness  mentioned  earlier. 
The  data  available  did  not  require  or  allow  a  more  accurate  determination  of 
this  value.     Second,   the  change  in  the  E„  test  value  does  cause  some  moving 
busses  to  be  processed  by  what  has  been  called  the  stop  bus  classifier.     The 
busses  that  are  affected  are  ones  that  are  accelerating  or  decelerating. 
The  "stopped  bus  classifier"  thus  becomes  the  "nonuniform  velocity  bus 
classifier".     In  retrospect  this  is  much  more  reasonable  -  more  data, 
better  definition.     The  velocity  estimate  is  not  changed  in  any  way  by  this. 
Third,  we  have  an  effect  caused  by  the  interaction  of  a  number  of  "real- 
world"  factors  that  was  not  seen  when  the  parameters  were  varied  one  at  a 
time  in  the  simulation. 

Fourth,   it  points  out  a  way  in  which  the  chosen  threshold  value  is  very  sub- 
optimal.     This  is  discussed  in  the  following  paragraph. 

Figure  29  illustrates  the  leading  edge  of  a  vehicle  signature.     The  values  1VL, 
M2,   Mo  are  amplitudes  (phase  values)  above  the  zero  or  steady-state  bias 
level  and  the  T.  are  the  corresponding  times. 

If  M„  were  the  chosen  threshold  value  and  the  intervals  between  the  M-  values 
is  the  amplitude  quantization,   then  relatively  large  time  errors  are  caused 
by  the  minimal  (±)  quantization  unit  change  in  the  bias  estimate.     Figure  30 
shows  how  the  time  value  is  made  insensitive  to  bias  estimate  errors  simply 
by  using  a  larger  vehicle  detection  threshold  that  places  the  threshold  in  the 
linear,   large  slope  part  of  the  signal  preceding  the  first  peak. 
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Figure  2  9.     Leading  Edge  of  a  Vehicle  Signature 


Figure  30.     Magnitude  versus  Time 
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Similar  coupling  of  the  start  (and  stop)  time  exists  with  center  line  dis- 
placement,  lead  length,  asphalt  versus  reinforced  concrete,  depth  of  paving 
material,   loop  age  and  any  other  factor  that  affects  the  signal  peak  phase 
value.     Using  a  larger  vehicle  detection  threshold  would  thus  reduce  the 
statistical  variance  of  the  vehicle  classes  and  increase  the  confidence  in  the 
classifier.     Unfortunately,   changing  the  threshold  changes  the  time- 
normalizing  factor  in  a  nonlinear  manner  and  this  affects  the  decision 
boundary  planes;  i.  e.  ,  a  completely  new  set  of  classifier  coefficients  is 
needed,  but  the  structure  is  the  same.     Since  all  of  this  analysis  is  the  re- 
sult of  one  exceptional  signal,   there  is  not  enough  evidence  to  justify  iterat- 
ing the  design  loop  at  this  time.     But,   if  the  problem  becomes  a  large  one, 
the  following  steps  can  be  taken: 

1)  Run  the  recorded  tapes  on  the  simulation  using  larger 
detection  threshold  values  and  doing  quantized  arithmetic. 
List  bias  and  all  features. 

2)  Perform  graphical  analysis  of  T.,   M-,   E.,   S.,    L.,   H-,   K. 

X  1  1  1  i.  1  X 

variation  with  the  detection  threshc 


3)  Choose  a  value  for  the  detection  threshold  that  lies  well 
within  the  linear  part  of  the  signal  and  which  detects  all 
busses, 

4)  If  the  graphical  analysis  in  2)  shows  a  functional  or  highly 
correlated  relationship  between  the  threshold  and  the  feature 
values,   then  use  this  to  determine  the  new  classifier  coef- 
ficients.    If  the  graphical  analysis  shows  no  simplifying 
relationship,    then  retrain  the  classifier  using  the  new  feature 
values. 

5)  Test  the  new  classifier  coefficients  using  recorded  data  tapes. 
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Bias  Estimation  --  When  no  vehicle  is  present  the  output  of  the  loop  phase 
detector  is  some  nonzero  constant  value.     This  is  the  bias.     The  bias  is 
expected  to  change  slowly  with  time,   temperature,   etc. ,  and  it  must  be 
removed  from  the  signal  value  before  vehicle  detection  or  feature  extraction 
are  done.     The  normalized  amplitude  features  are  insensitive  to  bias  esti- 
mate errors,   but  the  normalized  time  features  are  quite  sensitive  as  dis- 
cussed above.     The  sequel  will  summarize  our  experience  with  the  bias  and 
with  ways  of  estimating  it  and  then  discuss  some  of  the  problems  that  may 
arise. 

The  expected  total  range  of  bias  values  is  less  than  8  deg  (i.  e.  ,   if  the  loop 
were  initially  calibrated  to  output  0  deg  with  no  vehicle  present,   then  -4  deg 
to  +4  deg  will  contain  all  future  bias  values).     The  initial  simulation  esti- 
mated the  bias  with  a  digital  recursive  low-pass  filter  that  operated  only 
when  no  vehicle  was  present  (i.  e.  ,   signal  minus  bias  less  than  detection 
threshold).     Time  constants  in  the  range  1/10  sec  -  10  sec  were  satisfactory. 
This  algorithm  involves  a  multiplication,  which  the  preprocessor  cannot  per- 
form.    A  second  algorithm  using  shifts  to  replace  the  multiply  was  tested  for 
the  preprocessor  implementation.     This  did  not  work  because  the  12-bit  pre- 
processor word  was  too  small.     We  next  tried  a  method  that  adds  1  to  the 
bias  estimate  when  the  nonvehicle  signal  is  greater  than  the  estimate  and 
subtracts  1  when  the  signal  is  less  than  the  estimate.     This  is  about  as  simple 
as  a  low-pass  filter  can  be,  and,  when  tested,   it  worked. 

The  disadvantage  of  this  up /down  counter  method  of  filtering  lies  in  the  inter- 
relation between  time  constant  and  quantization.     The  time  constant  is  set  by 
the  time  interval  between  successive  bias  tests  (the  bias  estimate  is  com- 
pared with  the  sampled  signal  value  only  once  every  N  samples).    A  count  of 
1  up  or  down  corresponds  to  the  signal  quantization  value  (~l/4  deg  at 
present).     Thus  if  the  time  interval  is  too  small  the  filter  may  jump  up  and 
down  rapidly,   so  the  time  interval  is  chosen  large  to  make  the  output  rela- 
tively smooth.     But,   since  this  filter  does  not  smooth  the  values  finer  than 
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the  quantization  level,  an  error  in  the  bias  estimate  cannot  be  corrected  for 
the  full  time  interval  nor  is  it  compensated  for  by  smoothing.     This  causes 
a  problem  when  the  bias  correction  time  happens  to  occur  when  the  signal  is 
increasing  due  to  an  approaching  vehicle  but  before  the  signal  reaches  the 
threshold.     In  this  case  the  bias  will  be  increased  one  quantization  interval 
above  its  correct  value  and  the  time  estimates  will  be  in  error,  as  discussed 
previously. 

For  a  large  bias  correction  time  interval  (2-4  sec),   this  situation  is  infre- 
quent since  the  increasing  part  of  the  signal  is  less  than  0.  2  sec  long.     But 
the  error  can  occur  another  way.     A  vehicle  in  the  adjacent  lane  or  a  lane 
straddler  can  cause  a  small  increase  in  signal  level  that  looks  like  a  rapid 
bias  increase.     If  this  happens  before  a  vehicle  comes  by  in  the  main  lane 
then  the  bias  estimate  is  almost  certain  to  be  too  large.     Something  of  this 
happened  in  about  25  percent  of  the  Washington  street  data.     Using  a  larger 
vehicle  detection  threshold,  as  discussed  in  2),  would  cure  this  problem  by 
making  the  time  features  insensitive  to  bias  errors.     An  alternate  but  less 
desirable  way  would  be  to  introduce  bias  smoothing. 

o 

By  using  scaled  values  (stored  value  =  2    x  bias  estimate)  the  smallest  bias 
estimate  increment  can  be  made  a  fraction  of  the  quantization  interval.     Thus 
an  error  would  have  to  persist  for  a  number  of  correction  intervals  before 
its  effect  would  appear  in  the  lowest  significant  position.     To  implement  this 
in  the  preprocessor  without  using  the  shift  instructions: 

Scaled  bias  estimate  &»  A^ 

add  bias  increment 

A_  ►memory  =  new  scaled  bias  estimate 

A_  bits  8-11  ^•A1   =  bias,   unsealed 

This  would  handle  a  0  deg  -  4  deg  range  of  bias  value,   and  could  be  expanded 
to  0  deg  -  8  deg  by  using  arithmetic  overflow  detection. 

232 


For  the  sake  of  simplicity  of  implementation  and  because  the  simulation  was 
relatively  insensitive  to  the  following  method  of  bias  estimation,  a  simple 
scheme  of  bias  correction  was  employed.     At  present,   the  preprocessor  adds 
or  subtracts  1  from  the  bias  estimate  if  the  estimate  is  less  than  or  greater 
than  the  nonvehicle  signature  value.     The  estimate  is  not  changed  if  it  is  equal 
to  the  nonvehicle  signature  value.     This  update  process  occurs  once  every 
1.  5  seconds. 
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APPENDIX  A 

DERIVATION  OF  LINEAR  DISCRIMINANT 
CLASSIFIER  FOR  THE  2 -CLASS  UG  CASE 


A-priori  -  P^  ,      j  =  1,  2 
3 


1/2 


density  P(x|  C.)    -    [(2n)n  det  Vx^  ."]        '  exp[-|  (X-m^V^X-m.)] 


MAXIMUM  LIKELIHOOD  DECISION  RULE  DERIVATION 
(MINIMUM  PROBABILITY  OF  ERROR) 


Suppose  classification  rule  is 
C 


d(X)    = 


1 


Xe  XF(1) 


C2      :      Xe  XF(2) 


(A-l) 


where 


XF(1)   V     Xp(2) 


Xp,  j,      X-p(l).  A  X-p{2) 


TIi 


»ri 


P       =    p 
E  C. 


=    P 


Pr  Ed(X)    =    ^ICg]  +  Pc  Pr  Cd(X)    =    C2|C1] 
i  1 

/      P(X|  C2)dX  +  Pc  /       PCXlC^dX  , 


(A-2) 


xF(i) 


XF(2) 
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or  since 


XF(2)    I  XF  -  Xp(l) 


/        P(X  |  C2)dX  +  Pc       J  P(X|  C1)dX 


PE    =    PC2 

xF(D  A  xF-xF(i 


=    Pc         /      P(x|C2)dX  +  Pc      JptXlC^dX-  Pc      j      PfXlC^dX 

2xF(i)  xxF  1xF(D 


=    P 


+  PQ        j      P(x|C2)dX»Pc       j      P(X|Cj)dX 

1         2  x^d)  1xp(D 


and  we  can  see  that  P_,  is  minimized  when 

E 

J      [P(X|C2)PC    -  P(X|C1)PC  ]dX 


xF(i) 

is  minimized,  which  occurs  by  defining 

XF(1)    -    [X:    P(X|C1)PC    >P(XlC2)Pc]  (A-3) 

It  follows  from  (A-l)  and  (A-3)  that 

Xp(2)    =    Xp-Xp(l)    =     [X:    P(X|C1)PC    <P(X|C2)PC], 

Hence,  the  classification  rule  d(X)can  be  expressed,   defining  the  discriminant 

p(x|c1)p1 

function    A^X)    =     p/xl  C  )P        '     as  followS: 

d(X):     A  AX)    *      1 
1  ^ 


C2 
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or  taking  logs,  we  have  the  equivalent  form 


d(X):    A2(X)    = 


p(X|Ct)  /p 


P(xTc^   +  ,nlP2 


< 


(A -4) 


Since 


p(x|c1) 

p(Xlc') 


V 


1/2 


X.  2 


V 


T72 


exp 


X,  1 


,\   (X-m/v^  (X-mj) 


T     -1 
-  (X-m2rvx  2  (X-m2) 


where    |  Vx   •  |    =    det  Vx   • ,  we  have 


(p(x;c1)\    x     /ivX2| 

ln\p7xTc2l|=  Iln  \"T^7 


+    |  (X-m2)T  V^  *2  (X-m2) 


-|<x-mi>T  v£\  <x-mi) 


-i  . 


and  since  V^   -  is  symmetric,    i  =  1,2, 


T  TT  -1 


-T„-l 


T  „-l 


-T„-l 


(X-m^V^VX-m^    =    *    V-X  +  m.    Vx>  .  m.  -  2X    Vx>  ^ 


since  symmetry 


T      -1  T      -1 

=»    X1  V^-1.  m.    =    m.    VY   ;  X. 

X,  1         1  L  X,  1 
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For  example, 


[xrx2] 


a       b 
b       c 


m 


il 


Lmi2 


=  [xrx2] 


am.,  +  bm.n 

il  i2 

bm.,  +  cm._ 

il  i2 


and 


=    XJam^  +bm.„)  +X„(bm.1  +c     .„) 
1         il  i2  2         il        mi2 


[mil'mi2] 


a       b 
b       c 


X. 


LX2J 


[mil- 


m 


12 


aX,  +  bX„  ] 


bxl  +  cX2 


=    mil(aX1  +  bX2)  +  m.2(bX1  +  cX2> 


=    X1(amil  +  bmi2)  +  X^bm^  +  cmi2), 


Then, 


/pOClC-) 

^[itxTcp 


2  ln 


VX.2 

TVTT 


+  2  X    VX.  2  X  +  2  m2   VX?2  m2 


"I '    2  XTVX?2  m2  -  1  XTVX',11  X  "  I  ^V/l  ml 


1  T       -1 

+  J-  2X    vx,imi 


and  Equation  (A -4)  may  be  written  as 
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P1  1   .     'vx  ?]      1 

A2(X)    -    In  J-  +  \  In  t-X-Zj  +\ 


*T  <VX?2  ~  Vx\>  X 


+    xT  (VX,\  ml  -  VX?2  m2>  +  2  m2T  VX?2  m2 


1       T       -1 

2ml    VX,lml  ' 


(A-5) 


Note  that  A  (X)  =  0    =>    Equation  (A-5)  defines  a  quadratic  surface 


JXT<VX?2  "  V^l>  X  +  XT(VX,11  ml  "  VX?2  m2> 


1  /        T  T,  -1  T  Tr  -1  * 

+  2(m2      VX  2m2  "ml    VX,lml 


P9  1  VY    1 


=  constant. 


(A-6) 


If  V      =  V 
1  VX       VX,  1 


VX  2  '    A2   (X)  reduces  to  A2  (X) 


with 


A^(X)  =  ln^+X^V^1)  (n^  -  m2)  +  \  (m2  +  m^  V^1(m2  -  m^  (A-7) 


and  A„  (X)  =  0  implies  a  planar  (or  linear)  decision  surface; 


239 


defining 

WT    =    (Wr...,Wn)T  =  V^1(m2  -  mt) 

p 

In  p1-  XT  W+^(m2  +mi)TW  =  0 

or  XTW  -  WQ  =  0  (A-8) 

p 
with  WQ  =  +  |(m2  +  m^W  +  In  ^- 

and  Equation  (A-8)  is  the  equation  for  a  plane  in  XF  =  R 


W  /n         ^  w 

with  perpendicular  given  by  ITT^I]     for  ||w||     = /Z)     W.   with  TT^TTI    =  distance 

to  plane  from  origin  and  Wa    =    (Wj.W^,  .  -  •  ,  Wn,  Wo). 

Thus,    in  this  special  case,    the  optimal  decision  surface  is  a  linear  dis- 
criminant,  since  A„    is  a  linear  combination  of  feature  values.     That  A„  (X)  =  0 
defines  a  linear  discriminant  for  the  case  n  =  2  is  shown  as  follows: 


w1\ 
(X)   =  (xrx2)lW2/ 


-  wo   =   °   * 


with 


||wl|T=    Nr\  +  w*   . 


W1X1  +  W2X2  -  W0    =    ° 


www 

imi^i  +  fT#n:x2  -  nwi=  ° 


r~? 
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Solving  for  X2, 


W, 


w. 


w 


X, 


w 


x1  + 


w 


w. 


giving  a  line  in  two  space  with  slope    - 


wo  wo 

and   X„    intercept  at  -^—  ,    X1    intercept  at  ^—  . 

Ci  J. 


1 
4 

wo  ^^ 

w2 

«2 

/d 

K   ) 

x° 

|SLOPE  ll|  =2 

4    \!|W||,/ 

h, 

w0 

p 

w. 


Note  that  the  distance  from  the  plane  to  the  origin  is 


W, 


W, 


d    = 


wMi   W1  +  w22 


In  general,  a  point   X    on  the  hyperplane  defined  by    W&  =  (W^Wg, . . . ,  WR,  WQ) 
must  satisfy  [X  =  (X-, . . .  ,Xn>] 

(x1,x2,...,xn)-(w1,w2,...,wn)  =  w0. 
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If  we  look  at  a  point    X  on  the  hyperplane  as  a  vector   X   from  the  origin  to 
point  X,  the  angle  9  between  the  vector  W  and  X  is  given  by 
[using  W=  (Wv  W2, . . . ,  Wn)] 


X«  W 

COS   0      =    3—: -— 


IXllj  l|W   || 


For  6  -  0°,  X    is  the  perpendicular  from  the  origin  to  the  hyperplane  and  we 
have 

*-*  ^       = ■  I  •■  a  =   ||x|L  =  1^2-. 
MxMJIwIlj  "J       Mwllj 


But  since    X    is  assumed  to  be  a  point  on  the  hyperplane, 


X 

•  w 

— 

wo 

e, 

d 

w 

o 

I 

|w| 

ll 

• 
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USING  EQUATION  (A-7)  WHEN  ONLY  EXPERIMENTAL 
DATA  IS  AVAILABLE 

The  probLem  with  using  Equation  (A-7)  directly  is  that,  for  two  pattern 
classes,  V      1  =  V      9  is  often  not  true.     The  probLem  becomes: 

X  9  JL  X  f  & 

approximate    A2  (x)  in  (A- 5)  by  a  linear 
discriminant  A   0  (x)  that  is  of  the  form  of 
i     A2  (x)  given  in  (A-7). 

The  reason  we  want  to  make  this  approximation  is  to  allow  simple  implemen- 
tation of  the  classifier.     If  we  choose,  using  (A-7)  as  a  guide, 

C2 

A  A  A  AAA  A  -  A  A 

A2  (x)    =    X     V~2  (m2  -  rci^-y  (m2+  mi^     vx2  ^m2  "  ml^  "  KL  <     ° 

ci 

where  K-,    is  adjusted  to  minimize  the  error  probability  (since  the  actual 
a  priori  probabilities  Pt  and  PQ  are  seldom  known)  on  the  experimental  data 
comprising  the  SDD.     Note  also  that  V-2  and  m- ,  m9  must  be  estimated 
using  the  experimental  data. 

A  reasonable'   choice  for  V12  is  the  average  covariance  over  both  classes 
C-  and  C2.     This  is  given  by 

A  A  A  A  A  A  A  _, 

V12    =    plVl  +  P2V2+plp2(mrm2)(mrm2) 


A  A  A  A 


where  V-,  m.,  V2,  m2  are  computed  from  the  experimental  data  using 
Equations  2.1-2  a  and  b;  further,  we  use 


M1  M9 

P. 


yl         Mj+Mg  K2  Mx+M2       ' 

'See  Chapter  2,  pages  2  9  and  30,   Equations  (13)  through  (16).    This  Minimum 
Mean  §quare  estimate  of  the  coefficients  gives  a  discriminant    equivalent  to 
using  Vj2  as  above. 

+ 
Sample  Data  Distribution 
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Then  we  have 

C2 

*J  -A  -A  A- 1.A  A 

Ag(X)    =    (X  --fm2--|  m^1  V12  (m2  -  m^-K^  <     0  (A-9a) 

Cl 

One  may  also  use 

C2 

A_  A  A  _         A  -  A  A 

A^  (x)    =    (X-P2m2-p1m1)i  V^  (n^-m^-K^  <    0  (A-9b) 

C 


instead  of  (A- 9a)  in  order  to  refLect  the  fact  that  one  mean  value  has  been 
computed  using  a  larger  M.  (larger  p.)  than  the  other.     This  weighted  sum  is 
then  dependent  on  the  samples  taken;  if  M-  =  M2,  (A- 9b)  reduces  to  (A-9a). 

From  (A-2)  (the  expression  for  P-^,),  and  Equation  (A- 7),  the  expression  for 

L 
A„  (x)  obtained  from  A0(x)  when  Vv  -  =  V     9  =  V  ,  it  can  be  shown  (see  Van 

c>  &  X,  J.  Xj  Ci  X 

Trees  vol.   1,  pg.   97-99,  pg.   36-38)  that  P.-,  is  completely  determined  by  the 
Mahaionobis  distance 

2  T     -1 

dm(m1,m2)    =    (m1-m2)     Vx  (m^m^  . 

2 

Further,  it  is  shown  that  as  d      increases.  P_,  decreases.    Hence,  inter- 

class  complexity  is  inversely  proportional  to  d     .     A  reasonable  measure  of 
complexity  with  respect  to  the  decision  rule  given  by  (A-9b)  or  (A-9a)  is  then 

AAA  A  A  A         4  A  A 

dm(m1,m2)    =    (mj-m^     V12  (nij-mg) 
which  is  inversely  proportional  to  inter-class  complexity. 
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If  the  features  are  statistically  independent, 


V 


12 


q 
o 


o 
6 


n 


we  have 


*2 
"Am. 

dm  <ml.m2>    =    L    TT" 
i=l      i 


A.2 


(A-10) 


Thus,  for  ease  in  computation,  the  measure  of  complexity  is  taken  as  (A-10), 


using  & m?    =    (m      -  m9.)2,  with 

1  XI  £  1 


2  2  2 

CTi     =    Plali  +  P2CT2i 


from  the  form  of  V^. 
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APPENDIX  B 
PIECEWISE  LINEAR  DISCRIMINANTS 


Assume  the  multimodal  Gaussian  classes  to  be  distinguished  have  densities 
given  by 

Class  1: 

Ki    pi 


p(X 


ci)  =  pi  ~p—  p<x!ci> 


Class  2:. 

p(x|c2) 

K2    Pi 
-    2       2 

3=1      P2 

with 

Ki 

p<xici> 


Jj     P-         =    P-  ,    and  X  an  n-vector. 
3=1 

As  in  Appendix  A,  we  define  a  minimum  probability  of  error  classification 
rule,  that  is,  a.  choice  of  X    (l)and  X_(2)  such  that 

PE    =    P1  J  p(x|C1)dX  +  P2  J  p(X|C2)dX 
XF(2)  XF(1) 


is  minimized.     Using  the  same  reasoning  as  in  Appendix  A,  the  minimum 

P_,  decision  rule  is 

C 

d(X):    A(X)  >    i 
Cl 
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where 

C 


P1p(X\C1)  ^ 
A(X)    =    P2p(X|C2)   >     1-  (B-la) 


Cl 


However, 

pl  s  p3i 


krp(xici3)  cB-ib) 


■    j    -4-  pCx  |  c2J) 

which  cannot  be  reduced  to  a  simple  expression  as  was  done  in  Appendix  A. 

To  get  the  desired  simple  form  for  the  decision  rules,  a  suboptimal 
procedure  is  used.     Extend  the  original  2-class  problem  toaK.  +  K2  class 
problem  by  considering  each  mode  of  the  mixture  densities  as  a  separate 
class.     In  this  case,  we  desire  the  minimum  probability  of  error  for  the 
K1  +  K2  class  problem, 

2  K.  .K1+K2 

p     =    S  p .    S .   _L  -  £  J   p(x|c.3)dx 

i=l      l    j=l    P       K=l  x    (K)      L 

1      K^+(i-DKi  XF(K) 


(B-2) 


K1+K2  Kl+K2 


S        P.        X         J    p(X|C.)dX 
j  =  l  3      K=l        X    (K)       J 
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where 


C2        X;    j  *  K  +1 


P2        x;    j  *  Kj+1. 


Since  the  Xjr(K)  are  assumed  disjoint  and  UX„(K)  =  X„,we  have 


Kl  +  K2  A  A  (B-3) 

£         J  p(X|C.)dx    =  J  p(X|C,)dx 

K=l  J  J 

K^2      Xf(K)  XF  "  XF(;)) 


where  the  decision  rule 


d(x)    =   C        For   XeX    (]) 

J 


is  to  be  minimized  with  respect  to  P-p. 
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We  have 


K1+K2 


PE    =+      S       Pil    P<X!C-j)dX 
3=1  XF-XF(j) 

Kj+K  K!+K2  (B"4) 

*  A. 

S      p  J  P(x|  c  )dx  -       S     p  J  P(x|c  )dx 
j=1         xF  3=1      3Xf(j) 

K1+K2 

=  1-        S        P.J     p(X|  C.)dX 
3=1  XF(j)  ] 


and  to  minimize  P_,,   maximize 

E 

Ki+K2 


D        P.   f  p(X|C.)dX. 
i=l  3  J  '3 


e  = 

xF(j) 

To  maximize  e  ,  choose 

XF(j)    =    [XeXF:    P^.pCxI  a)  ^  PKp(X|CK),    K=l,   . . . ,  K^Kg}  . 

This  gives  the  decision  rule  d(X)  in  the  form 

d(X):    decide  C.  for  j  3  P.p(X|  C.)  =  max  {  PKp(X|  C^),  K=l, .  .  .  ,^+K^ 

Since  the  maximum  can  be  determined  by  a  pairwise  comparison  of  the 

[P.p(X|  C.)  }, 
the  decision  rule  d(X)  in  algorithmic  form  is: 
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ALGORITHM  1  (d(X) ) 

[0]      a    *  P^XJCj) 

J    «-  1 
I     *•  1 

[1]      I     *■  1+  1 

if  I>  Kt+K2,  goto  [4] 


C2^     if    PjPfXlc'j)    >    !    8oto[l] 
otherwise  go  to  [3] 

[3]     J    <-  I 

a    *■  Pj  p(X|  Cj) 

go  to  [  1] 

J  J-Kl 

[4]      decide  cLass  CT    =»    decide  class  C-     if  J  ^  K-,  C2  otherwise. 

Stop. 

Note  that  each  test  in  step  [2]  above  is  of  the  form 

A       i^,...,^  +K   }  -  {Cj} 

PTp(X|CT)   . 
A  i(X)    =       jF      V     >  1  (B-5) 

Pip(x|ci)  ^i v2^9 

which  gives  the  same  results  as  in  the  Appendix  A  expressions  for  A2(X), 

and  can  be  approximate  d  by  A2L(X).     When  A2L(X)  is  used  the  result  is  a 
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Linear  discriminant  for  each  pair  of  the  (K-  +  K2)  subclasses.     The 
resulting  decision  surface  for  the  original  two  class  problem  is  then  piece- 
wise  linear.     Note  that  we  are  not  interested  in  distinguishing  between  the 
subclasses  of  class  1,  or  of  class  2,  only  between  the  subclass  of  1  and  the 
subclass  of  2.     Thus  the  algorithm  can  be  modified  as  follows,  resulting  in 
fewer  tests  as  follows:    (Algorithm  1  requires  K-  +  K2  -  1  tests) 


ALGORITHM  2  (d(X)  ) 


[0]     a '«-    P1p(X|C11) 
JC  =  1 


l2    *° 
h    +1 


[1]      I2-I2+l 

Go  to  [3]  unless  I2  >  K2;  then  go  to  [  6] 


[2]     lt    «-  It  +  1 

Go  to  [  4]  unless  I-  >  K- ;  then  go  to  [  6] 


[3]     0    *•     P2      P(X|C2  ');  goto  [5] 
[4]     a*-     Pj  x  pCXlCj  x);  goto  [5] 


[5]      If£>  1    JC  =  1,  go  to  [1] 

otherwise  JC  =  2,  go  to  [2] 
[6]      Decide  C. 


MC 

[Stop] 
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The  decision  rule  d(X)  given  by  Algorithm  1  and  B-5,   while  optimal  (mini- 
mum PE)  for  the  K..  +  K„  class  problem,    is  suboptimal  for  the  two  class 
problem  of  interest  (thus  Alg.   2  is  suboptimal).     This  follows  since  deciding 
C„  based  on  Algorithm  1  (C-,   J  >K.. )  ensures  only  that 

Pj  p(X  |Cj)    =    max   {  Pj  p(X  |Cj)  }; 

it  is  still  possible  for 

Kl      .  .         K2       .  .  ' 

£    pi  P(x  Ic3)  >  E    p39  p(x  |cb , 

3=1     *  *        j=l      2  Z 


violating  B-la. 


252 


APPENDIX  C 
CTC  PROGRAM  COMPUTATIONS 


STATISTICAL  SCATTER  COMPUTATIONS 
(using  notation  of  Chapter  3) 

Means  (X.(.j)  is  an  n-vector    =»   m.  an  n- vector) 

1)  class  mean 

M. 

m     =    jj-     S     X(j)  (i=  1 N) 

i    3=1 

2)  total  mean 

n 
mTOT    =    .^     Pim2 


Dispersions  (matrices) 
1)      within  class 


Mi 
6.    =  4-  2    x<3)  xT(j) 

i         M.  .    .,        l  J       l     J 


2)      mean  between  class 

N  T 

6_,    =     Z/    P.  m.  m. 
B  ..ill 

1=1 
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3)      mean  within  class 

N 
6       =    S    P.  6. 
w         i=l      l    1 


Covariances  (matrices) 
1)      within  class 


T 
V.    =    6.  -  m.  m. 
i  ill 


2)  mean  between  class 

T 
VB    =    6B  "  mTOT  mTOT 

3)  average  within  class 

N 

v  =    Tj     p.  v. 

i=l       L 

4)  mean  within  class 

T 
VW         5W  "  mTOT  mTOT 

5)  total 


vT   =   vB  +  V 
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Feature  Standard  Deviations  (j,    i  =  1, .  .  .  .  ,   n)  -  scalars 

1)  within  class 

^(3)  =  Vv^jj) 

2)  mean  between  class 

*B(3)    =VVB(j,j) 

3)  average  within  class 

5(j)  =Vv(j,j) 

4)  total 


<MJ)    =Vv^j,j) 


Feature  Correlations  (scalar) 


1)      within  class 


Pi(j' k)    =    cr.(j)  CTi(k) 


2)      mean  between  class 


VB(j»  k> 
PB(j,k)    -    aB(j)crB(k) 
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3)      average  within  class 


P(j,  k) 


_    V(j,k) 


4)      total 


VT(j,  k) 
PT(j,k)    =    a^j}  a^(k) 


Reduction  of  Formulae 


V       =  SP.V.    =   DP. (6.  -  m.  m1)    =   Ep.6.  -Dp.  m.  m 
li  li  li  li  ill 


V„,  =   DP. 6.  -  (Ep.m.)  (SP.m.) 
W  i  i  i    r  li 


V^    =   Ep.m.m1  -  (SP.m.)  (£p.m.) 
B  ill        x        l     r  v        li 


V™    =    V^  +  V    =   Ep.6.  -EP.m.mr+SP.m.m1  -  (Ep.m.)  (SP.m.) 
T  B  li  ill  l    l    l  l    l  l    r 


=    V. 


W 


Vw  serves  as  a  double  check  on  accuracy  in  program  computations, 


DISTANCE  COMPUTATION  IN  CTC 

Mi 
1)      m(i)    =    ±-  S      X.(j) 

1  j  =  l 
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N 


2)      mTOT    =     D      Pi  m(i) 

■I 


3)      mr(i)    =    m(i)  -  mTOT 


T 
4)      ar(i,  j)    =    mr  (i)  I  mr(j)     ; 


2     A 


II  mr(i)|rj    §    *<i.i) 


5)      0(i,j)    =    a(i,j)/Vor(i,  i)Va(j,j)    =    cos  0     since  cos  0  = 


X  •   Y 


IWIjllYll, 


6)      d2(i,j)    =    tt(i,i)  +  <*(j,j)  -  2V«(i,i)V«(j,j)    j3(i,j) 


E^ 


m(i)|!2+  ||m  (j)||2  -  2  mT(i)  I  m  (j) 
r         I  r         I  r 


|mr(i)  -  mr(j) 


=    ||m(i)  -m(j)||2 


7)      0(i,  j)    =    ATAN 


•5 


1  -  g  (i,.i) 


180 

TT 


257 


(8)    Proof  of  (6) 


l12 


m 


^ijll2  =    \\m1\\*+\[£i2\\2-2mi:<   m2 


d|(i,j)    = 


*   ||2  +  ||m.||2  -2m.-   m. 
I  3     I  x         ^ 


A    rr\  A  A    rp  a  a    rin  a 

m.    Im.+m.    I  m.  -  2  m.    I  m. 
1  l  3  3  i  3 


d|(i,  j)    =    ||mr(i)  -  mr(3)||2    =    mj(i)  I  mr(i)+  mj(j)  I  mr<j) 


-  2  m^(i)  I  mr(j) 


and  m^a)    =    m^  -  mTOT 
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'*"'  O  A  T"1  A  A  A 

d    (i,  j)    =    (m.  -  mTOT)      1(111.  -  m^oT*  +  *mi  "  mTOT*  ^mi  "  mTOT) 

A  T         A 

-  2  (m    -  mTOT)      I(m    -  mTOT) 

A  T      A  T  T  A 

=    m.    I  mi  +  mTOT  I  mTQT  -  2  mTOT  I  m. 

A    ^  A  rp  T  A 

+  m     I  m.  +  mTOT  I  mTOT  -  2  ™TOT  I  m. 

J  J  J 

A    T1  A  T*  T1  A 

-  2  mi    I  m.  -  2  mTOT  l  mTOT  +  2  mTOT  1  mi 

A   HP 

+  2  mj    I  mTOT 
-    !|m1l|2+||m||2  +  2  ||mTOT!|2-2   ||mTOT||2 

I  ^         I 

T  A  A  X  A  A 

-  2  mTOT  I  (mi  +  m  )  +  2  mTOT   I  (m.  +  m.) 

A     T"*  A 

-2  m.    I  m. 
1  3 

=     ||m.!|2+  ||m  ||2   -  2mTIm.    =    d2(i,j) 
1     I  3      x  L  3  -^ 


PROJECTIONS  ONTO  SUBSPACES  OF  Xp 

> 

Program  computes  projections  as  follows:    given  a  transformation  matrix 
(m  rows  x  n  columns)  A,  and  an  n-vector  X  e  X-p,,   the  transformation  is  (onto 
the  subspace  defined  by  A) 

Y    =    A  L  (AA  L )       AX 
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where  Y  is  an  n-vector.     Projections  onto  the  complement  of  the  subspace 
defined  by  A  are  computed  using 

Y    =    X  -  AT  (AAT)       A  X. 
Note  that  the  program  allows  scaling  of  the  results,  i.  e. , 


Yg    =    Y  •   scale  factor. 
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APPENDIX  D 
LISTING  OF  THE  CTC  PROGRAM 
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aFSRTR 

1 
? 

3 

5 

6 

7 

8 

9 

10 

li 

12 

13 

1* 

15 

16 

17 

18 

19 
20 
21 
22 
23 
2»> 
25 
26 
27 
2? 
29 
30 
31 
3? 
33 
3* 
35 
36 
37 
3* 
3" 
t*? 
M 
<*? 

<*<=- 
47 
4* 
4? 
5" 
51 
5? 
5? 
5<* 
55 
5* 
57 
5* 
5" 


AN  LS> 
C**» 

c 

c««» 

c 

c 

c 

c 

c 

c«*» 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


Qe 

CASCADED  THRESHPLD  CLASSIFIER  PROGRAM 


B-qO 


CARD  INPUT 
LINEPRJNTER  OUTPUT 
TYPEWRITER  M6NIT9R 


SJBROUTJNeS 


N  IS  MATRIX  9R  VECTOR  gl^E 


D^DPR8D(A#B'C#D#N) 
MPR9D(A*B*C*/N(L)/» 


MSU^(Si,A,S2*B#C#N) 
MVPRV»D('A#ti#'C«N) 


MATRIX  PR9DUCT  D»A»B»C 

MATRIX  PRODUCT  C«A#B 

A  IS  M('l)  BY  N{2)j  B  Is  N{?)  BY  N<3) 

MATRIX  SUM  C«S1»A  *  S2#B 

Si*  S?  SCAlARS 

MATRIX  VECT8R  PRODUCT  C"A«B 

A  IS  N  BY  N,  g  IS  N  BY  1 

SEVAL(A, evj LAMBDA, B* IV#N)  SMALLEST  EIGENVALUE  LAm,BDA  AND 

CORRESPONDING  EIGENVECTOR  EV  9F  A 

TDINVR(K1*K2#NR,NC* A,MNR*  IWA,DET) 

MATRIX  A  NR  BY  NC  IS  HetUr^ED  INVEwTED 
AND  DETERMINANT  DET ' RETURNED 
DETERMINANT  DET  RETURNED 

TRA0E0FF(NC#Nf:",Nrv<FEAT#TVl.B#TV?#NS#SC3RE#M8t)E) 

TABULAR  LISTING  8F  TRADE9FF  CURVE  0ATA 

ORDERED  BY  SC9RE 
TRANSPUjB^N)  B»A  TRANSPOSE 

VlPR9D(A#fc!*C*N)  VECTOR  INNER  PRODUCT  C«A«B 

C  IS  SCALAR 
V?PRPD(A,B*C#N)  VECTOR  BUTER  PRODUCT  CRA#B 

C  IS  m  BY  N  MART  I X 
VSU1<Sl#A,S?#B#C*N")        VECTOR  SUM  C»Si*A  *  S?«6 


ARRAYS 

9C8V--BET,sEEN  CLASS  C8VARIANCE  (COvaRIANCE  OF  THf  CLASS  MEANS) 

CLAS--T.YPE  T9  CLASS  ASSJGNmfnt 

COV--CLASS  C9VAPIANCES 

CISP--CLASS  DISPERSIONS 

FEAT--FEATURE  VECTORS  AND  IDENTIFICATION;  FIELDS 

FLA3--PR0GRAM  CPNTR8L  FLAGS 

INCARD--CARD  INPUT  BUFFER 

ITV--NUMBER  ANjD  SCALE  FACTOR  FOR  MEi*  FEATURE  DEFINITIONS 

|TV?-»jEMP8WARY  VECTOR 

LIST--LINE  PRINTFR  LIST  9PTIPNS 

K.S  — NUMBER  OF  Samples  In  CLASSES 

PR6g.. WEIGHT  FACTORS  FOR  CLASSES 

SAVE--I\C9RF  STPRAGE  AREA 

SC8RE--TRADE0FF  SCORES*  ALS^  USED  FOR  BOOLEAN  BlT  STRINGS 

SFEAT--SELECTED  FEATURES 

TC0V--T6TAL  C8VA»IA\CE 

ALSO  USED  FOR  COEFFICIENTS  FOR  NEw  FEatURE 


Tvj.. TEMPORARY  MATRIX* 

DEFINITIONS 
Tmj.-TEmPQRARy  MATRIX 
Tvi--TEmPQRA«y  VECTOR, 
Tv2--TEmP6R*Ry  VECTOR 


ALSO  USED  AS  CONSTANT  FPR  Ne^  FEATURE  DEFINITIONS 


262 


c 


60:  C      TV3--TEMPQRARY  VECTOR 

61:  C     UC8V--*ITHIN  CLASS  CSvarIANCe  (AVERAGE  CLASS  CSVaRJANCE) 

6?:  C      X3AR--CLASS  PEAKS 

63:  C      x3ART--T8TAL  MEAN 

64:  C 

65:  C      PARAMETERS 

6t:  C 

67:  C     DATE--PRft(jRA*  DATE 

6*:  C      I0--PR»GPA^  IDENTIFIER--FIRST  F8UR  CHARACTERS 

69!  C      ID1--PR6GRAM  IDE^T  I  F  I'ER  — L  AST  FOUR  CHARACTERS 

7C:  C      <M8DE--CLASSIFIPR  METW8D 

71 :  C      M9DE2--SEC8NDARY  FEATURE  TRANSFORMATION  FLAG 

7?:  C      NC--NUUMBER  SF  CLASSES,  maximum  PF  jo 

73:  C      NCT.--NUMQER  9F  CPNTR8L  CA«D  I^pJT  CODES 

74!  C      NDT--NUMBER  0F  DATA  CARD  iNpUT  CODES 

75:  C      NF-.NU^bER  OF  FEATURES/   MAvlMlJM  OF  10 

76:  C      MFv-. NUMBER  8F  FEATURE  VECTORS,   MAxIMUM  8F  200 

77:  C      NaCON.-pRejECTIPN  FLAG,  .1  FOR  SUBSpACE,  -2  F^R  C9*PLEMENT 

78:  C      NSAv--2c#NR.  8F  VECT8RS  SAvED 

79:  C      NSS--NUv,BER  8F  SAMPLES  SELECTED 

8C:  C      NT--NUMBER  8F  TYPES,   MAXIMUM  OF  20 

81: 

82! 

83; 

84:         C8HM8N  SAVE(40CC),NSAV 

85:        C9MM8N  INCARD(19)iFEAT(?0*?00)iPR0B(10),CLAS(20),SFEAT(l0) 

86:       i   ,NS(o:iQ)#XBAP(lO/lC)/T*l(lO>10>'TM2(io*lO>'DIsP(lO/lO*lO> 
87;       2   ,C8V(l0,l0#10),TC8V(lC,iCI)iWC8V(l0,l0),aC8V(10,l0)  ,xBART(lo> 
8*:       3   ,Tvl(l0)*TV2( 10)*Tv3(lC)* ITv2{10),Sc8rE(200) 
89:        INTEGER  LIST(20),FLAG(2o)'ITV(20) 

90:        E3UlvALENCE( ITV,TV2) 

91  :  INTEGER    FEAT, CLAS,SFEAT,DATE, SAVE, F|_A3 

92:  c 

93:  C      PREST8RE  PARAMETERS 

94;        NAME  LIST 

95:  C 

96:  C      PEMflVE  NE*T  STATEMENT  F9»  NORMAL  PROGRAM  ExECUTIpN 

97:        CALL  RESTART 

9t>:  c 

99:  C      INITIALIZE. 

.oc:  c 

.01:  NDT.5 

.0?:  NCT«8 

.03:  NFV.C 

.04:      nc.o 
.05:      mt.o 
.06:      Nr.o 
.07:       KM8DE.0 
.0*:       NPC8N.0 
.09*.        DATE. 3 

.10:      n.o 
.11:      ioi. o 

12:        "0DE2.0 
.13:        NSS-0 
,14:        DP  12  1.1,20 
,15:   12    LIST( I j.FLAG( I).0 

,16:  c 

,17:  C      SETS  FEAT,PR8a,CLAS,SFEAT,NS, AND  XBAR((i,l)  T8  {4, 9))  ■  ZER8 
13:        D9  10  i»l,4100 
.19:   10    FEAT(I,i).0 

.2c:  c 
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121: 

122: 
123: 
12*: 

1255 

126: 
127: 
128: 
129: 
130: 
131 : 
132: 
133: 
13*: 
135: 
136: 
137: 
138: 
139: 
i*o: 
im: 
1*2: 
1*3: 
1**: 
1*5: 
1*6: 
1*7: 
1*8: 
1*9: 
150: 
151 J 
152: 
153: 
15*: 
155: 
156: 
157: 
158: 

1595 

160: 

1*1 8 

162: 
163: 
16*: 
165: 
166: 
167: 
168: 
169: 
170: 
17X1 

172: 
173: 
17*: 
175: 
176: 
177: 
178: 
179: 

180S 

181: 


c * *•*•••«**«»« 

C      CONTROL  L86P 

c 

100    G9  T©  300 

101   CONTINUE 
C 

C      SECONDARY  FEATUPES  F9R  q(JH    DETECTOR 

C     M9DE2  ■  1  ©R  2  FOR  TRANSF8RMING  FEATURES  T©  SECONDARY  FEATURES 
IF(M8DE?.GT.O)  G©  T©  55q 


PR9CESS  COEFFICIENT  CARDS 

FLAG(3)  •  NR.  ©F  COEFFICIENT  CARDS 

IP"(FLAG(3).GT.O}  G©  TQ  jjoo 

D©  DATA  PREPARATISN 
68  T©  5oO 


C     TRADEOFF  LISTING  ©PTI9NS 

C      FLAQ<*>  ■  NR.  ©F  FEATURE  TRADEOFF  LISTINGS 

121   IF(FLAG{if).GT.O)  G©  T©  ^00 
C 
C     CALCULATE  STATISTICS 

1*0   GO  T9  600 

1*1   C9NTINUE 
C 

C     CLASSIFIER  OPTIONS 
C     CLASSIFIER  METH6DS  i  AND  2 

IF(1.LE.KMBDE«LE»2)  G9  T9  RQO 
C 
C     CLASSIFIER  METH9D  3 

IF(KHBDE.EQ»3)  G©  TO  8*0 
GO  T9  160 

151  C9NTINUE 
C 

C     CLASS  PAIR  TRADE9FF  LIStINqS 
D©  155  IP«1#NC-1 
D9  155  jPiIP*l#NC 
IP(<H9DE.LE.O)  G9  T©  155 
^RITE(2#2307)  DATE/ID, ID1 
WRITE^^jOl)  IP/JP 
G©  T9  (152*153)  KM9DE 

152  CALL  TRADEOFF ( NO NF,NFV, Ft AT, c©V(l/ IP/ JP)*COV( IP, JP* JP) *TV2#NS 
1   /SCORE/ 1) 

G©  T8  155 

153  CALL  TRADEOFF ( NC* NF, NF V,FE AT, C©V(i,jP/ IP )/COV(jP, IP/ IP )*TV2,Ns 

1   /SCORE, 1) 
155   CONTINUE 

ALL9W  USER  TO  READY  CARD  DEC<  FOR  NEXT  INPUT 
160   PAUSE  1 

GO  TO  Tgp  6F  C0N.TR9L  L09P 
GO  TO  loo 


INPUT  M©DULE 


300   OjTPUT(g) 1  INPUT', •  ' 
0UTPUT(3) • INPUT' 
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182. 

C 

183 

C 

18*. 

185 

C 

186 

c 

187 

188 

189 

c 

190 

c 

191 

c 

192 

c 

193 

c 

194 

c 

195 

196 

c 

197 

c 

1-98 

199 

c 

200. 

c 

201 

202 

c 

203 

c 

204 

'   c 

205 

:  c 

206 

c 

207 

c 

20* 

209. 

c 

210! 

c 

211! 

212! 

213: 

c 

21*. 

c 

215 

216' 

c 

217 

c 

218 

.  c 

219 

220 

221 

,E 

222 

223 

22* 

:  c 

225 

:  c 

226 

,  c 

227 

228 

229 

:  c 

230 

:  c 

231 

:  C 

232 

233 

234 

235 

236 

237 

238 

239 

:  C 

240 

:  C 

241 

:  c 

242 

4 

5 

NT 

NF 

34Q 

350 

READ  CARD  TP  BUFFER 
RE  AD  Hi'  2300)  I#INCARD 

ejTpUT  CARD  IMAGE  ExCEpT  F9<?  FEATURF  VECT3R  DATA,  JD,  EXECUTE 
IF ( ( I  »NE.  ;)  .AMD.  (I  .Nt.  ii)  .AND.  (I  •NE»"l2)  .AMD. 
*  (I  »NE.  -1)  .AND.  (I  »NE«  -99))  WRlTE(2j  2316)  j  ,  INCARD 

CHEC<  F0R  DATA  CARD 

JF  CSDE  IS     1  ?  3 

CARD  FEAT  vEC  C^F  vEC   NC 

SWITCH  T8     31,  320        33: 

IF(0»LT.I.LE»NDTj  38  T8  t 3lo*32Q'33o>3*0'350)  I 

CHECK  FSR  FIRST  FEATURE  CARD  F8R  BUS  DETECT8R 
IF(I.EQ.H)  G8  T8  3100 

CHECK  P8R  SEC8ND  FEATURE  CARD  F<)R  BUS  DETECT8R 
IF(  I.EQ.12)  G8  TR  3Ho 

CHECK  FeR  CPNTR6L  CARD 

IF  C^dE  IS    -1     -2  -3  -4       -5  -6  -7  -S 

CARD  ID     kMQqe  LIST  c?FSTPp.E  NFV.O  M8de2  TrAdE8f  MPqOK 

SWITCH  T8     36q    37q  38q  39q      45o  *60  *7o  48q 

lF(-NCT.LE..I«LT.O)  G^  T8(360'370'38o*39o#*50'*60/*70'*80)  -I 

CHECK  FQR  EXECUTE 

IF( I.E0.-99)  G6  Tft  400 

9UTPUT(2)  "CARD  N8T  USED' 

READ  NExT  CARD 
G8  T8  3q2 

FEATURE  VECT8R  INPUT 

310   NFV.NFV+i 

FEAT(1*nFV)"NFV 

FLAG(l)  C8UNTS  THE  DUMBER  8^  CARDS  READ  SINCE  LAST  EXECUTE 
FLAg(1>pFUAg(  1)4-1 

FILL  NEXT  C8LUMN  8F  FEAT  ARRAY  FR8M  CARD. 

FEAT(11.2o,NFV)  HOLDS  FEATURE  VECT8R 

DECQDE(76/2301/ JNCARD) ( fEaT( j,nFV ) >J«2,7 ) > ( FEaT( j*nFV) , J. 1 1 ,20) 

G8  T9  3q2 

first  feature  card  f8r  bus  detector 

3100  NFV»^FV+1 

FEAT( 1'NFV)»MFV 

FLAG(1)»FLAG(1)+1 

DECBDEt  76, 2301,  INCARD)  (  FEAT(  j,NFV  ) ,  J- 2,3  )  >  (  FEAT  <  j,NFV)  ,  J.5,7  ) 

FEAT(5*NFV)»FEAT(5/NFV).10*FEAT(7,NFV) 

FEAT(7/NFV)»0 

G9  T8  3o2 

SEC9ND  FEATURE  CARD  F8R  BUS  DETECT8R 

3110  DEC9DE( 76, 2301* INCARD) { FEAT( J,NFV*1 ) / J.U *  19) 
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?*3:  c 

244;  C      SEARCH  FOR  MATCHING  ID  FR»M  PREVIOUSLY  PROCESSED  1ST  FEATURE  CAP° 

245:        D9  3112  j»NFV#i,-i 

246;         IF(FEAT( 12/NFV+l) .EG« FEAT < ?, J ) )  36  TO  3114 

247:  3112  CONTINUE 

248:         PUTPUTO)  'NB  MATCH' 

249:         8JTPUT(2)  'NO  MATCH  ',  FEAT  (  \  ]  ,  NF\/  +  i  ),  FEAT  (  12*  NFV  +  !  ) 

250:        G*  TO  3C2 

251!  3114  |_»NFV*1 

252:  C 

253:  C      CMECK  FeR  DUPLICATE  RUNS  USING  A  SINGLE  FIRST  FEATURE  CARD 

254:         IF(FEAT(7,J).NE.0>  GO  TQ  3l?Q 

255:  C 

256:  C      FEAT(7#j)  .0  IF  NP  MATCH  UNTIL  NBaI 

257:  3115  FEAT(7#j),FEAT(H,L) 

258:        FEAT(<mj),7 

259:        C9  3116  «.l>7 

260 :  3116  FEAT(10*<,j)-FEAT(l?+KiL) 

261  :        G«?  Tfi  302 

262:  C 

263:  C      BUILD  NEw  FIRST  CARD  F8R  DUPLICATE  RUN  NUMBERS 

264:  3120  09  3123  1.2*6 

265:  3123  FEAT(  I/NFv+1)  ■  FEAT(I,j) 

266:  NFV»J»NFV+1 

267:  FEAT(1#j)«j 

268:  G9    TO    3n5 

269:  C 

27C:  C  COEFFICIENT    VECTOR    INPUT 

271:  c 

272:  C      FlAG(3)  C8uNTS  COEFFICIENT  CAt?DS  READ  THIS  TIME 

273:  C      <T  VALUES  STOrED  IN  ITV(IMO) 

274:  C      KP  VALUES  STBrEC  IN  ITV(JI-PO) 

275:  C      CONSTANTS  STBREC  IN  Tvi(l-lO) 

276:  C      C9EFFICIENTS  STeRED  In  T*1(J*1-10) 

277:  C      ONLY  TEN  COEFFICIENT  CARDS  CAN  BE  PROCESSED 

278:  C 

279:  320   IF(FLAG(3) tGE.lC^  GO  TO  302 

28o:         IF(NF.Eq.q)  9UTPUT(3)  »NF»".  F9R  2  CARD' 

281:        I-FLAG(3)«FLAG(3)*l 

282:        DECODE  (76*  2315/  JMCARO)  iTV  (  I  )  ,  jTv  (  10+  I )  ,  Tvi  (  I  >  >  (  T"l  (  J'  I  )  '  J-  I'M*" ) 

283:        GO  Tp  3o2 

284:  C 

285:  C      WEIGHT  VECTOR  INPUT  ,    NQ^ALIZE 

286;  C 

287:  330   DEC0DE(76#2302*INCARD)  NC 

288:  C 

289:  C      MAXIMUM  NR.  BF  CLASSES  T^AT  CAN  BE  PROCESSED  IS  {0 

290:        IF(NC.GT.IO)  NC»10 

291:        DEC0DE(76/2303#INCARD)J>(PR^B(J)#J.1*NC) 

292:  C 

293:  C      CALCULATE  CLASS  A-PRIORI  PROBABILITIES  FROM  a'EIGhTS  ON  CLASS  CA"9 

29i+:        A.O 

295:        DO  331  I.l/NC 

296:  331   A.A*PR9B(I) 

297:        D«  332  I-l/NC 

298:  332   PR9B( I).PR9B( I)/A 

299:        GO  TO  3^2 

300 :  c 

301:  C      CLASS  ASSIGNMENT  VECT9R 

302:  C 

303:  34Q   DEC9DE(76*2302* IKCAPD)  \T 
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30* 
305 

30*: 

307; 

308: 

309; 

310 

311 

31?: 

313; 

31*: 

315; 

316; 

317: 

318: 

319: 

320 

321 

32?: 

323; 

32* 
325 

326: 
327: 
325 

33: 

331 

33? 

33? 

33*: 

335; 

336< 

337 

33! 

33^: 

3*':; 

3*1 

34'*: 

"344 

3*5: 

346; 
347; 
348: 
3491 

35c: 

351 

352 

353 

354; 

355: 

356; 

357; 

358 

359: 

360 

361 

362; 

363: 

364; 


350 


360 


370 


380 


382 

384 
388 


390 


392 


394 
396 


►"AxI^Ul"  NR»  8F  tvfEs  TwAT  C*v  HE"  PRRCtssED  IS  20 
TF(NT.GT«2o)  MT«?o 

CLAS(I)  ■  CLASS  NUMBER  TB  w^ICH  TYPE  I  IS  ASSlGVO 
DECIDE (76* 2304, I\CADD) \, (CLAS( I)*I»1*NT) 

6^  TP  3-2 

FEATURE  SELECTION  VFCTBR 

DEC9DE(76*2302*  IN'CAKD)  \F 

MAXIMUM  NR,  BF  FEATURES  THAT  CAN  BE  USED  IS  10 
IC(MF.GT.io)  NF»10 

DECIDE  (76*  2304*  IisCAPD)  I*  (  SFEATf  I  )  *  I«  l.,NF  ) 
G°>  TB  3c2 

DATE  AND  ID 

DEC9DE<76,2306, IK  CAPO)  DATE, ID, IDl 
*RIT6.(3,23C7)  DaTE,ID,ID1 
>5ITE(2,?3Q7)  DATE, ID, IDl 

G3  T3  3;2 

CLASSIFIER  M6DE 

DECBDE(76,2301*  INCAFD)  <^HDE*  LCqUKiT 
ejTPUT(c)  LCBUNT 
G?  TB  3q2 

LISTING  BPTIBnS 

DeC9De<76,2305,  INCARD)  L  I  St( I > *  I  *  1 1 ' 20 

09  388  I»H*2C 

J.LIST(I) 

SET    (IF    j.GT.O)     BR    CLEAR    (IF    j.|_T.O)     LUTING    SpTjBN    I 
IF(J)     38?,388,3?4 

LIST(-J)«0 
G8    T6    388 
LIST(JU1 
C9NTINUF 
G8    T8    3f2 

RESTORE  SAVED  Da^a  BEHIND  NF*i  DATA 

CHECK  F6P  N9  FEATU«E  VECTBRS  SAVED  TB  REST9RE 
IPjMSAV.EU'O")  Ge  TB  3q2 
8UTPUT(?)  iDATA  RESTBRED* 
IF(FLAa(l, .NE.O)  68  Tg  394 

RESTBRE  AT  BEGINNING  8F  FLAT  ARRAY  IF  NB  CARDS  R£AD  THIS  T I  ME 
03  392  I»l,NSAV 
FEAT( I,i ),SAVE<  I  ) 
NiFV»NSAv/20 

G9  TB  302 

REST8RE  F6LL8WING  FEATURE  VECTBRS  LEADED  BY  CARD5  THIS  I  IKE 
D9  396  I.jjNSAV 
FEAT(20«NFV+I*1 )«SAvE(  I  , 
MFV»NFV+NSAV/20 
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36b:  GQ  TB  3o2 

366:  C 

367:  C  EXECUTE  CARD 

368!  C 

369:  C  FLAGl  •  NR.  BF  FEATURE  VECT8R  CARDS  READ  SINCE  LaST  -99 

370:  400  8UTPUT(2)»EXECUTE»/FLAG(1) 

371:  c 

372:  C  CHECK  F6R  NR.  8F  CLASSES/  MR.  8P  TYPES  8R  NR.  8F  FEATURES  .  0 

373:  IF(NC*Nt»NF.GT.O>  G6  TB  401 

374;  B'JT»UT(3)  'ERR8P  «  ,NC*NT,NF 

37b:  C 

376:  C  ALLBw  USER  T8  SET  SFNSE  SWITCH  1 

377:  PAUSE  2 

378:  401  CONTINUE 

379:  c 

38C:  C  USER  MAY  INPUT  PARAfS  8N  'TYPEWRITER  IF  SSl  IS  9N 

381:  IF(SENSE  SkHCH  1)  402*404 

38?:  C 

383:  C  TYPEWRITER  INPUT 

38^:  c  upper  Case,  q  ts  terminate   in=>ut 

385:  402  INPUT(3) 

386:  c 

387:  c  data  summary 

38H!  c  shbrt  list 

389:  404  BJT»UT(?)  ^FV*NC*NT,NF#kMBDE 

390:  ?JTPUT(?)  'PRBB' 

391:  WRITE(2,2309)  PRBB ( I > » I . 1 > MC 

39?:  ^RITE(2,231Q)  1,1.1, NT 

39'*:  ^RITE(2,2311)  CLAS(  I )  ,  I.1#NT 

39*»:  PUTPUT(2)  iSELECTED  FEATURES' 

39b:  aRITE(2,231?)  SFEAT{ I ) , I«1#NF 

396:  c 

397:  C  L8N3  LIST 

39«:  4C6  8JTPUT(2) 'FEATURE  VECT8RS' 

399:  HRITE(2,231M     I*I-l#l0 

^00:  c«  4io  j«i/NFv 

401:  c 

40?:  C  LIST  FEATURE  VECTORS  IF  SS«,  IS  BFF 

40~:  IC(SENSE  SWITCH  k)    411*409 

404:  409  WRITE(2,2313)  FEAT( I# j ) , 1.1, ?0 

40b:  410  CONTINUE 

40t>:  ^11  CONTINUE 

407:  C 

40*:  C  SAVE  UP  T8  20C  FFATURE  vECT«9S  IV  CRRE 

40*:  C  SAVE  RNlY  \F    NE*  FEATURE  Ca^DS  /ERE  REaD  THIS  Tlr'.E 

41C:  IP(FLACj(1)  .ECO)  G8  TB  iCl 

411:  NSAV«MI\(20»NFV#400C) 

41?:  C«  4?0  I.l/XSAV 

41"^:  4?0  qAVE(  p«FEAT{  j,d 

414:  ft.Aj(1).0 

41b  :  r,?  T«  lr'j 

416:  c 

417;  C  'WERLAY    Nfc.W    DATA 

41"':  C 

«*1^:  C  VPV    PBI\TS    T6    Thr    \rxT    AVAlLA(3Lr    SPACE     IN    ARRAY    (rEAT 

42C  :  «»50  ^  rv»? 

421  ;  Ci'-    TS    3?2 

•♦2?:  C 

•♦2?:  C  SEC^N^A-y    FEATu-E    CPNTRr»L    F*R    RUS    DETECTPR 

*?« :  c 

h2^:  «*60  ^ECQnE(7t.,?^d/  I'  CA^D)     ■••  *»[?£? 
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426:  G*    TP    3C? 

427!  C 

428:  C  TRADE8FF    LISTING    PN    A    FEATjwp;    v»LUE 

if  29:  c 

43C:  470   FlA3(4).F|,AG(4)4.1 

431 :  c 

43?:  C      ST8RE  ID  NUMBER  PF  FEATURE  T9  BE  TRaDEPFF  LISTED 

433:       DEC0DE(76»23O2*INCARDj  ITVp(  FLAG(  4)  , 

434:        GP  TP  3d? 

435:  c 

436:  C      FEATURE  TRA\'SFe<?KATI9\l  cPNTWf,L  JS I Nq  PA^AMETE*  CaRDS 

437:  c 

438:  480   DEC9DE(76#2302* IMCARD)  NPCPN 

439:        PJTPUT(2)  NPCPN 

44C:        GP  TQ  3Q2 

44i :  c 

44?:  c»» •##••« ••***•»»*»«*»•«»«••« 

443:  C      DATA  PREPARATI6N  M9DULE 

444:  c»****»» ••..#.« 

445:  c 

446:  C      DETERMINE  CLASS  FR9N  TYPE/  NUMBER  PF  SAMPLES  PfW  CLASS  AND 

447:  C      EXTRACT  SELECTED  FEATURES 

448:  500   BUTPU.Tfg)  •  '/'PREP'*1  • 

449:        P'JTPUT(3)  'PREP' 

450:        DtJ  502  I«0#10 

451:  502   NS(I)«0 

45?:        DP  ^?0  <»l/NFv 

453;  c 

454;  C      DETERMl\E  CLaSS  NUMBER  FPf*  TYPr 

455:  C      FEATo,*.)  „  TyPF  NUMBER,  FEAT(10,i<)  „  CLASS  NU""!£irR  OF  v£CTe=?  K 

456:         UFEAT(io,O.KlN(CLAS(FE4l(?#<)  )#NCj 

457:  c 

45*:  C      EXTRACT  SELECTED  FEATURES 

459:  C      SFEAT(j)  ,  jTh  SELECTED  FEATURE 

46C:        DP  510  J-l/^F 

461:  510   FEAT(l0  +  j,K)«FEAT(SrEAT(J)+10»i<-) 

46?:  C 

463:  C      INCREMENT  CLASS  I  SAMPLE  CPUNT 

464;  5?o   VS( I )"NS( I )+l 

465:        K'SS»0 

466:        DP  5?5  I«1*NC 

467:  5?5   NSS«NSS+NS( I) 

46*:  C 

469:  C      s.JMMARY  PuTPLT 

47G:        a»ITE(  2/?500)  (  I,  1,0/10)  /  fNS(  1  )*  I«3#*-C) 

471:        8JTPUT(?)  »  SNSS/»  ' 

47?:        IF(NSS»qT.O)  08  TS  l?l 

473:        PUTPUT(3,  'ERRP^'/NSS 

474:        PAUSE  3 

475:        GB  Tb  1?i 

476:  C 

477:  C      SEC5NDARY  FEATURE  TRA'-JSFPKMAT  IPN  Fp"  3US  DETECTOR 

478;  C 

479;  550   G8  Tg  (55l#55l)  -PDE? 

460:  551   j«l 

481 :       dp  554  K»i/\Fv 

48?:  c 

483:  C      PAC<  FEAT  APRAY  IF  •>  p  ?>D  CARD  ^ATC-ED  TP  THIS  15T  CARD  DATA 
48^:         IF(FEAT(7><)  •EQ.O)  GP  T>)  554 
48b:         FACT»FEATni'K)*FFAT(i2,i<) 

4«e :       ir(Me>DE?.EQ»?)  pact«feat(  l»#o 
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487:  ri6« (FEAT( 11>K)#100C« )/FACT 

48*:  rEAT(ll,j),(FEAT(i3,<)#iC00.)/P*CT 

489:  FEAT(l2/J).(FEAT(H/K)#lCO0.)/fr*CT 

490:  FACT«FEAT(13*kUFEAT(14,k) 

^91:  rEAT(l3,jj.(FEAT(  16*<)»lC00«  > /FEAT(  J5/.K ) 

49?:  FEAT(14,j),{FEAT(l7/<)*l900.)/FFAT(i5#K) 

493:  FEATJ15,J).FACT 

49^:  FEAT(16,J).F16 

495:  FEAT(l7,j)«FEATni'J)+FEAT(l?#j) 

496 :  D0  55?  I  ■  l  *  10 

497:  552   FEAT(I'j)  ■  FEAT(I*K) 

49P:  FEAT(4*j),4 

499:  J-J+l 

500:  554   CONTINUE 

501:  NFV-J-1 

50?:  *PITE{2,?308> 

503:  0JTPUT(?)  M0DE2 

504:  M0DE?»0 

505:  GO  TO  404 

so*-:  c 

507:  C» ****•»•#•***** »•#•#**»*•» »##**» ###♦#»» 

508:  C      STATISTICAL  CALCULATIONS 

50^:  c««*#«#»**«##*#»»**»**«»»»»*#»**»»»#**»» 

5io:  c 

511:  C      CALCULATE  CLASS  MEANS,  Dl SPFRS IONS,  COVAPIANCES,  CORRELATIONS, 

512:  C      STANDARD  DEVIATION'S,  ^E AN-TO-CENTER  DISTANCES* 

513:  C      BETWEEN  CLASS  CPVARIANCE'  STANDAPD  DEVIATION,  PAjR.WlSE  DISTANCES 

514:  C      AND  DIW[CTI»NAL  CBSINrS  AND  ANGLES 

515:  C      TOTAL  MEAN,  C?VAPJANCE#  C&RELATIONS,  STANDARD  DEvlATIONS. 

516:  C 

517:  6C0   v.RlTE(2,2307)  DATE,ID»ID1 

51«:  OJTPUT(?)  •  S'STAT'*'  ' 

519:  eUTPUTO)  'STAT' 

520:  DO  605  I»l,?630 

52i:  605   X3AR( l»] ).q« 

52?:  DO  6?0  L«l,NFv 

523:  <L»rEAT(i0»L) 

524:  C 

525:  C      CMECK  Fep  FEATUFE  VECTgR  ASSIGNED  T<*  CLASS  ZEK9 

526;  IF<<L»Er.o)  GO  Tf»  620 

527:  IF"(NS(<L)  «EQ»0)  GO  TO  6?C 

52*:  C 

529:  C      CALCULATE  CLASS  *FlGHT  FACT=»P  FPO*  \R.  OF  SAMPLES  IN  CLASS 

53C:  »»1»/NS(KL> 

531:  c 

53?:  C      CHANGE  FEATURE  VFCT6R  TO  FLOATING  P«INT 

533:  DO  610  M,1,NF 

534;  610   Tvl(M>"FL6AT<FEAT(lo*M,L>> 

535:  C 

536:  C      CALCULATE  CLASS  MEAN  VECTBP3 

537:  CALL  VSUM(  l  .*XBAP(1,K|_)  jP'Tvi        '  XB  AR  (  1  *<\_)  >\  F  ) 

538:  C 

539:  C     CALCULATE  DISPERSION  MAT^ICIES 

54C:  CALL  v6pR(3D(  TV1/TV]              *Tv}*NF) 

5*i:  CALL  MSuM(i«'DlSP(i*ifKL)'p'™l»CISP(  l#i#<L)»NF) 

54?:  6?0   C°NTINUE 

543:  C 

544:  C               LIST    "fcAN    vf.CTOPS 

545:  ojTs  jT(j)      •     ','tfl\    vECToWS'''      ' 

54':  /.-ITE(2#26:    )     X  #  T  ■  1  #  *-C 
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54  s-: 

630 

C  i|M 

C 

550 

c 

551 

55? 

553 

554, 

555 

556 

557 

6*c 

55? 

644 

ssy 

645 

56C 

561 

C 

56?  ' 

C 

563 

564, 

C 

565 

c 

566 

567, 

c 

56* 

c 

56° 

57C. 

c 

571 

c 

57? 

57? 

c 

574 

c 

575! 

576 

650 

577: 

c 

578' 

c 

579. 

580 

581: 

c 

582! 

c 

58? 

58'*: 

c 

585. 

c 

586i 

587 

661 

58« 

589 

590 

662 

591 

592 

C 

593 

c 

594 

595 

c 

596 

c 

597 

598 

c 

599 

c 

600 

601 

602 

603 

604 

60b 

670 

606 

.  c 

607 

!  C 

60« 

*3ITE.(2,2601  )     (  >«'^<  I«  J)  >  J»l  >'<C) 

?  =  T!^    5    Te    LIST    DISPEHSlf^    "AT^ICIFS 

IF(LlST(e;)  .ECO)     00    Te>    644 

PJTPUT(?)     »     STISPERSl^b'.'     • 

DS    640    *.l/> C 

U^ITE(2,2600)     < 

D9    640    I«1*NP 

tv(?lTE(2#?60D     (H  ISP(  I'  J*<)»  J-l/ vr  ) 

CONTINUE 

0s?    645    1.1/200 

T  M 1  (  I  *  1 )  .  0 

D<-    650    K..1/VC 

•^EAV    BUTE*    PP^OUCT    T9    TM? 

CALL    VaPRBD(X8AP<l'K)#XBAH(l*<)#TM2,\F) 

C5VAOIA\CES    T8    CPV 

CALL    ^SuMf  i  .VDISP(  1/1#<)*-i.#T.w2jC9v<  1j1#*)'NF) 

ACCUMULATE  T8TA|_  ^EAN  I\  XB^RT 

CALL  VSuM(  1  .  ,XBA^T»PR9B(K)  #>,:BAR(  1  ,<)  ,XBAPT,\F  ) 

S'JM  HF  MEAN  8UTrc  PR0OUCTS  T9  7vl 
CALL  MSuM(  i.jTMi#pRPB(K)'>tM?f  TMIjNF) 

ACCUMULATE  *ITHIN  CeVARIANCF  IN  .-jC9v 

Call  msuM( i  .*.wCf:\/*pp98(K)'C«v(  i*i#<)'*iCf>V'NF) 

CeNTlNUE 

«ET*EEN  Ce^IACCE  T9  BC°V 
CALL  V9PR8D(XBART,XbA3T,TM?,VF) 
CALL  MSuM(l.#TMi,-l,#TMp#BC?Vf^F) 

T9TAL  CPvARlANCr  T0  TC6v 

CALL  MSuMj 1 ., wCPv/ l./3C^V/TC«V/^F) 

TEST  BN^Y  CUECK  PN  C0VARIAMCE  »•»#»»»»*##*»*»»»»♦**«# 

D9  661  <-l*100 

TS1(<#1)«0» 

D9  662  K«l,N:C 

CALL  *SU^(  l"TMiiPR63(K)  »DlS°(  1»1  /<)/Tmi,\F) 

CONTINUE 

CaLL  HSUM(  l»#TMi*-l»#TM2#  J^i  #i^P) 

PPTIPN  6  T0  LIST  xBART  AND  CLASS  C9vARlAhCES 
IF(lISJ(6) lECtO)  30  T9  670 

LIST  T0TAL  MEAN  VECT9R 

^RITE(2i2feO?5  NF#(  IjI«1#NF)*{XBA«TU)*I*1*NF) 

LIST  CLASS  CRvARlANCES 

9jTPuT(2)  1  ', »C9VArIANcES», •  • 

DP  670  K«1*NC 

InRITE(2«260C)  < 

D9  670  I»1/NF 

lc RITE  (2/24,01)  (CBV{  I*J/K>'J»1#NF) 

C9MTINUE 

PpTIPN  7  T9  LIST  TCPV, wC0V#BC°V 
IF(LIST(7)  .EQ.O)  G0  T9  *78 
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©oy; 

610: 

611 

612! 

613: 

61*: 

61b' 

616: 

617: 

618: 

619: 

620 

621 

62?: 

623: 

62* 

625: 

626; 

627: 

62«: 

62V: 

630 

631 

632: 

633: 

63* 

635: 

636 

637: 

638: 

639: 

6*: 

6*1 

6*2: 

6*3 

6**. 

6*5 

6*6 

6*7 

6*8 

6*9: 

65C: 

651 

652: 

653: 

65* 

655: 

656; 

657: 

658: 

659; 

66j 

661 

66?: 

663; 

66* 

665; 

666; 

667: 

668; 

669 


672 


674 


6  76 


678 


679 


68Q 


681 


682 

C 

C 


684 


LIST  TSTALjBETwEEn  And  *IT-lI\  CPVARJAnCES 

PUTPUT(?)  •  S'TPTAL  C8vA&  I  A\CE  '  >   '  • 

D9  67?  I»l,NF 

^r?ITE(2i2fe01)  (TCPV(  I,J]»J«tAF) 

C8NTINUE 

PuTPUT(p)  •  S'w.ITHlM  C9VASIANCE  '/ •  • 

DP  67*  I«liNF 

wRlTE(2,2601)  (*C?V(  I«J)#J»1#NF.) 

CSNiTlNUE 

6UTPUT(2J  '  '# 'BETwEENI  cbvarI ANCE % '  ' 

DP  676  I  ■  i  >  n. F 

W  I  TE(  2/2601  )  (BCPV(  I  »  J)  #  J»1  »kvF) 

CPNJTINUf 

LIST  TEST  QlvLY  CfVARlAKrf  CMEC* 
PuTpUT(?)  •  ', 'CPvAPlANcE  CKEC'K'*'  ' 
Dp.  678  I»1#NF 

^PITE(2i2bOD  (TH(I'J)»J'I  «'NiF) 
CONTINUE 

CALCULATE  CPR«ELATIf-VS 


CALCULATE  T6TAL  CPSPELATltfN  AND  LIST 

CALL  D"iDpk©D(TMi  (  \,  4  )  ,  TC»V#T^i  (l  ,  4)  VTM2*  NF  ) 

*'JT?UT(?)  •  S'TfJTAL' 

B'JTPUT(p)  'STANDARD  DEVIATIONS' 

WRJTE(2*2601)  P"*l<  t#"l  >-^  I".l 

ejT»UT(g)  •  ', 'CRRRELATIPNS' 
DP  684  I«i>NF 


^PITE(2/2601) 

CONTINUE 


(Tm2< I/J)/JM»nF) 


CALCULATE  WlTHlv  C8PPELAT I P\!  AMD  LIST 

CALL    D^iDPR8D(TMi  (  l  ,  5  )  ,  a'C^V  ,  T"t  (  1 ,  5  )  ,  T^g,  NF  ) 

PUTPUT(?)      '     'iMTHIM 

eUTPUT(?)  'STANDARD  DEVIATIONS' 

WRITE  (2>2fe01)  (T^l(  I/?)/lil/V!F) 

PjTPUT(p)     •     •,  •CPP^ELATIPA'S' 

DP    6«6    Iii^F 

*"ITE(2,?601  )     (  Tf'2<  1/  j)  /  J«1»*F  ) 
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6701 

673 

6721 

673! 

67*: 

675: 

676: 

677: 

67*: 

679! 

68C 

681 

68? 

683 

68*: 

685: 

686: 

687: 

688! 

689: 

690 : 

691 

69? 

693: 

69*: 

695; 

696; 

697: 

698: 

699; 

70C; 

701 

702: 

703: 

70*: 

705: 

706: 

707: 

70?: 

709; 

710: 

711 

712: 

713: 

71*; 

7i5: 

716: 

717; 

71**: 

719; 

720: 

721 

722; 

723: 

72*: 

725: 

726; 

727; 

728; 

729: 

730 


686   CONTINUE 

: 

C     CALCULATE  BETWEEN  CBRRELATI9NS  AND  LIST 

CALL  DMDPR9C{TMin,6)#BCBV,T«i(  l'6),TM2,\Pj 
6JTPUT(?)  •  »# 'BETWEEN' 
PUTPUT(?)  'STANDARD  DfV  I  AT  I^NS  ' 
*RITE<2,2601)  |Tfl(Ii3)/I'l*KF) 
PUTPUT(?)  •  '# 'CORRELATIONS' 
06  688  IalfNF 

WRITE (2/ 2601)  (T"g( I*j)#j»l#vP) 
688   CONTINUE 


690 


692 


694 


702 


7:* 


706 


CALCULATE  AND  LIST  DISTANCE  MATRIX 
D9  690  K-l^C 

*eans  Relative  tp  tptal  *ean 

CALL  VSijH(  i  .>XB*C(  1  »<)  /-l  '>X3\QT,     Tl-?(  l,<)  ,NF) 
CONTINUE 

CALCULATE  DlSTAf^Ct  MATRIX 

DP  692~I.1/NC 

DB  69?  j«l#I 

CALL  VlPRfc)D(  tM?(1*I)»  T^2<l*J)*TMKIij)#NF) 

Tmkjj  1  ).TM1(  I#j) 
C^NTINUr 

N9RMALlzE 

DB    69*    i«i*NC 

TVK  I)"SQRT(TH1  (I, I)) 

TV2( DM »/TVl(  I  ) 

CALL    DMDPRBD(TV?*TMl,TVc#Tv?,NiC) 

CALCULATE  AND  LIST  pAlR^ISr  DISTANCES 

D9  702  1-2, NC 

DO  70?  j.l/I-1 

T-K I#J).SQRT(T» 1( I/I)+Tvl( J#j)-?.#TV1( I)»Tv1(j)»Tm2( I,jj 

TMKJ,I)«TM1(  I, j) 

PJTPUT(2)  •  ','PAIRulSE  DISTANCES' 

kRlTE(2*2600)  Iil.l/NC 

D9  70*  I»1#.NC 

iARITE(2,2601)  (T^1(IjJ),j»i*NC) 

CONTINUE 

LIST  DISTANCES  AN-D  CBSlNES 

PJTPUT(2)'  '/'CFN^ER  T9  m£a\«-,  'DISTANCE' 

i*RITE(2i2600)  I/I»1*N'C 

kRITE(2#S60D    TVl  (  I  )  '  I«  l'NC 

9UTpUT(2)     •     ','CIRECTIBN    CBSINES' 

kRITE(2/260G)  I/!.1/NC 

09  706  I«1>nc 

wRITE(2>260l)  (T^?( I»J)«J>1'*C) 

CONTINUE 

CONVERT  To  DEGREES  and  Ll^T 

DO  70s  1,2/NC 

DO  708  j. 1,1-1 

COS  »  Tm2(  i,jj 

SIN  .  SqRT(1-CBS»#2) 

T^?(lij)«  ATAN{  SIN/CBS)  .^7.?5=;s 

T^12(J*I)»TM?(  I, jj 
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73i: 

70S 

73?: 

7331 

73*: 

735: 

736: 

737! 

710 

738: 

739: 

c 

740: 

c**»* 

74i: 

c 

74?: 

c»*»» 

743: 

c 

744: 

c 

745: 

c 

746: 

c 

747: 

c 

748: 

c 

749: 

c 

750 : 

8C0 

751 : 

752: 

753: 

754: 

755: 

c 

756! 

c 

757: 

75«: 

759; 

76C! 

76i: 

76?: 

763: 

76^: 

765' 

c 

766 

c 

767 

768 

769 

c 

770 

c 

77l 

772 

:  C 

773 

:  c 

774 

:  C 

775 

;  c 

776 

:  C 

777 

:  C 

77a 

:   805 

779 

7gC 

781 

:  C 

782 

:  C 

783 

784 

785 

:  C 

786 

:  C 

787 

788 

:  C 

789 

:  C 

790 

791 

r-i?(j,j)«o. 

■M2(  NC'NC)  «C« 

6JTPUT(2)  »  •,  »0IRECTI6.\  avql.ES' 

•*RITE(2,?60C>  I*  I-1#NC 

DP  710  I.1#NC 

»RITE(2,2601> 

CONTINUE 

G9  Tft  1^1 


(TM2(  I, j) ,JM>NC) 


"ETH8D  I  CLASSIFIER 

GENERATES  THE  CPFFFICIENT  VFCTP^S  FPR  ALL  CLASS  pAJRS 

l.LE.I»LT.J.LE«K'C  .    TmE  VECTOR  F9R  I,j  IS  STPRrD  IN 

^ETNeO  i  METM9D  p 

CBV(1#I,J)    C8V(l*J#T)  CeEETICIE^T  VECT9K 

CPV(IfJjJ)    C8V(J#I/I)  C^NSTAMT 

*RITE(2*2£01>  <*PDE 
WRITE(3,2feol)  K^PDE 
FLAG(2)»<MPDE 
09  810  I ■ 1 # NC-I 
D9  810  J»I+1*NC 

CALCULATE  PAIqwTSE  CLASS  WEIGmT  FACTORS  Pi  anu  Pj 
PI.PR9B(  I  ) 
oj.PRRB( J) 
PP»PI*Pj 

PI.DJ/Pp 

DJ»PJ/PP 
PIJ»PI*PJ 

3IJ«PU#(  j-I) 

Y  «I#PUj«PJ 

PAlR/il.SE    MEAN    IN'XBART,     DIFFERENCE    IN    Tvi 
CALL    VSlJM(Pl#xBAR<  1 ,  I )  »  PJ/  X?  AR  (  \  ,  j  )  ,  xBAPT/  NF  ) 
CALL    VS|jM(QlJ,XpAR(  1#J),-QIJ*X3*,»(i#  I  )»TVl#NF) 

<*l8DE    ■    1  >RP    MpTHeD    1     AN0    ?    pBR    METM9D    2 
G?    TP    (805*8?0)    KM8DE 

^EThSd  1  »»»»»#****#»»♦»#»##»«■»»»# 

FINOS  THE  LEAST  SQUARES  APDR*xTwATIPN  T9  A  LINEAR  FUNCTI8N 
ASSIGNIMG  I  T9  SAMPLES  IN  CLASS  I,  j  T8  SAMPLES  I  N  CLASS  J 
PAHWI$E  T8TAL  C9VARIANCE  T*  TCHV 

CaLL  MSiiM<Pi,0ISP(  1*1 1  I)#PjfDISP(  1#1*  J)iTCPV/NF) 
CALL  v9pR8D(XBAPT,XRARTiTMl,NF) 
CALL  MSuM(i,#TC9V,-l./TMl.#TC9V/NF) 

CALCULATE  INVERSE  TP  TC8V 

CALL  TDINvR(Ki,k?,NF/NF,TC9V#10' ITv,DET) 

9UTPUT(?)  »INvERSF'/<i*<?/OET 

CALCULATE  COEFFICIENT  VECJPR  TP   C8v(l*I/J) 
CALL  MVpReD(TCQV/TVl/  CfiVd*  I*  J)*MF) 

CALCULATE  CPNSTANT  T8   C9V(!'J»J) 
CALL  VIPR8D(  Cevjlj I/J) »XBA^T,B  # NF ) 
C9V  (  I*j/j)«Y  -B 
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79; 
793: 

794 

79b 

79* 

797: 

79* 

?9< 

«0f\ 

801 

30?: 

803: 

304' 

s05; 

80^: 

807 

80* 

809: 

810! 

811 

81? 

813 

814 

81*: 

816: 

817: 

818! 

819: 

«2C 

821 

82H: 

8?3: 

%?4 : 

825: 

82fc 

827 

82? 

829: 

830  J 

831 

83? 

833: 

834: 

835; 

83fr 

837. 

33> 

839: 

84^ 

841 

84? 

843: 

844 

845: 

84^: 

847; 

848; 

849; 

850; 

851 

852; 


*&ITE.(2,?*o  :  >  I'J'  C?V(I*J#J)»<  C?v<<»  I*  j)t<*l>    r  ) 
810   C^NTINUfc 

RTTURN  T°  CnNTRf'L  LP"=> 
^ c  T°  1^1 

V.j-iBD  ?  «••••*••«»«»»•.««»«•»•»»• 

FINDS  Tme  DI^FCTIPM  ?F  S^ALLfST  DEVIATION  ^  1 7  -i  I  -  CLASS  PAIR 

«Y  FJN0I\U  SKALL"ST  E I  GFN-VALH=:  "f  Tuf  w-l  I TH I  \  COv/ARjANCt  rAT^jx 

PAI^aIS:   aITHIN  C'PVA^T  A'.Cb  ti  j"! 

320       CALL  V4Pf?eO(X3AF{  i,  J  )  ,xvAK(  i  ,  j  )  ,tmp,nF) 

CALL  I"SUK(PI,QI«(  1,1.  Ii  #-=>T#T'-^,T^1>\iF) 

CALL  mSjjm, l,#TMi#Pj#DISP(l#l. J)»TM1,NF) 

CALL  VaPt?6Ci<XBAF(  ]  /  j)  .,  XB*K(  1 .  j)  ,TM2,  \F  ) 

CALL  ^iSjm(  j  ,,tmi  ,-Pj*  T^?#  t-'i_,k.F) 

!  FIND    S!V|ALLF^T    EIGE^VECTf)0    TQ    SC"'^F 

CALL    SEvAL(THi,-SCf?RFj7.,T*2*  !Tv/'r) 
CALL    VlPt?6D(SCQf<T.*Tvi,x^F) 
y,X/QU»(  j-I  > 

COEFFICIENT    VECTOR    T3    C>V(1#JjI) 
0?    830    N»l#NF 
B30       C*V(N,J,  I),SCs>RE-(M)/X 

C?MSTA\t    TP    C9Vf J, If  I) 

CALL    VlPReO(CP>V(  .  ,J,  I>,xSART,3,\F) 

C"V( J, I,  I  ).Y-B 

k-ITE  (2,  2«Q'-  )     1/  J'CrV(  J,  I*  !  )  >  (  Cnv(-0  J'  I  )  »<*  \'  \F  ) 

5?    T«    810 

LOGICAL    ^fabt    CL ASSIF Irk    •««•••*»•* 

USES    FfATu«ES    I-LCSI.At 

CALCUL*Trb    A    r)OcLpAK     : U  T    STRING    F  93    FA'CH    FcATUR^;    VF.CTfiR 


a*p       [Jc    «44    \«i/'  Fv  i 

SC9RE(N),o 

D^    »4?    L»1#LC5UVT 

SWIFT  LF.FT  ?NE  RIT 
SCe;'E(Ni)«2»SC^RF  (,N) 

SET  b  1 1«  1  IF  FEATURE  .&T.  ?,  «IT«0  TF  FEATURE  •!.£  •  0 
!F{FeAT( 10+L*N) .GT.C)  SC°kE' v USC^Ef^  +  l 

842   CSNTINJOE 

?.bi+      cQNTINUE 

^^ITE(2/2307)  DATE, ID, I3i 

?JT°UT(?)  LGeUNT 

CALL    TRADEeFF(\c,LCPU\T,KF  VfFFAT^VwC,  TV2*NSiSCM^F,  <) 

&ETJRN  TS  C^NTRFL  L?6p 
3*  T9  16Q 


Z***+»*»* *************»*+**»**** ******** 

C  P59CESS    COEFFICIENT    CARDS 

C  CALCULATE    ALL    FUNCTION'S    Btf?(?E    =?EPLACIV3    3RIGI\AL    FEATURE    VALUES 

C*»***»*»»5**>»*»»«5*»*»»**»*»u*»»*»*»** 

C 
1100    ^RITE(2,?10?> 

D^    1101    <«1 «FLAC(?) 
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8531 

85* 

35b: 

856; 

857: 

35? 

859  • 

860: 

861 

862: 

863; 

86* 

86b; 

866; 

367; 

86?: 

86^: 

37C 

871 

872; 

87  3: 

37* 

87*: 

37* 
877: 

37? 

379: 

880 

881 
88? 

38^: 

R8* 

885: 

386: 

387; 

*8* 

38  9 

39-: 

891 

89? 

393: 

39* 

395: 

39*: 

897; 

39* 

899; 

90C; 

901 

902: 

903: 

90* 

905 

90*: 

907: 

90* 

909; 

qlP! 

911 

912 

913: 


1101  W3lTE(2>?e.o:))  ITV<K)*  ITy(  10V<)  #  Tyl  (  <  )$  (  TMl  (  J*<)  *  j«  I*NF  ) 

CHECK  Few  FEATURE  PPQjECTIQN 
ir(NPCtK.bT.G)  OP  TP  mc 

^LD  FEATURES  REPLACED  BY  NEi«  FEATURES  DEFINED  BY  COEFF  CARDS 

D?  1105  N.l/NFV 

D3  1103  K«1/FLA&(3) 

Y»TV1(K) 

D*  1102  J«1#N'F 

1102  V'.Y+TM1(  J#K)»FEAT(10+J*\) 

1103  Tv3(*)«Y 

Dft  110**  <sl*F(.AG(3) 

IF(  ITV(K)  .GT»10J  G'8  T«*  HO* 

FEAT(  10+ITV(K)/^  )»TV3(«)«IT\/(  10  +  <)-t-C»5 
110*  CONTINUE 
1105  C9NTINUP 

59  TP  U?4 


dRQjECTs  ALL  FEATURF  vL'CTf-?S  SM"  TME  "SUB-'=PACb  (  6R  ITS  ^RTHl^AL 
C°MPLEflE^T  )  DETFPMINrC  L-Y  USING  THr  C^EFF  ICItNT '  VEC.T&RS 
AS  A  SPA  MM  I  G  SfT  FPM  THE  SU3SP*CE. 

THJS  Dt;E?  N8T  USE  TH£  ?ND  PR  4TH  FIELDS  HF  TKp-  ?  CAWJ. 

TME";-iSD  FlELT  PF  The  I^t  ?  CARD  SPECIFIES  THE  SCALING. 

1110  TFpJf»Ct^  »uE»3)  Gfi  TK  up* 

SET    NSPA.M    b    N3.    f>F    C&EFF.    fJAPDS 
MSPAN    .    FL.AGO) 
SCALE. ITV(11  ) 
IF(SCALE.EQ.O)     SCALE-1. 

CALCULATE    PpSjECTIS?'    MATRIX1    Tr>    RCPV 

T7ANSP9SE    8F     A     IS     P     TKj 
OUT    A     1Mb    Tf? 

CALL    TRANkPfT-MifT^NF, 

CALi_    rPRf)Q(T^?,Tv:i/TcTV/vS=)AN  ,  vr,  VJPAM) 

CALL    TDINvR(Ki*kP#NSpa\^vSpa^ , TCPV, \ 0# ITv j DET ) 

PUTPi.lTt?)     »  lNVEpSEr#<l*<?'OET 

CALL    MPpocjTCPV/V'g,  ACev>NSPA\,\iSPA"  ,  \'F  , 

CALL    *PKf}1„<T^i/L,rT;V>ec^»/>NF/vSPA^\JF) 

TRANSF9PM  FEATURE  V^CTQkS 

IF    NPCtt\    r     1     $     FPPJECT    TP    SL-IBSPACE 

JF    NPCOV    *    ?    >     PROJECT    T^»    COMPLEMENT    f»F    s^BspAC^ 

G?J    TH(  1112/11 14)    SjPC9-j 
1112    X  =  0« 

Yal. 

PJT3UT(?>  'SU3SPACE' 

GP  T'l  1116 
111*  X*l« 

Y»-1  • 

PUTDIJT(?)  •CPMPLP,yENT» 
1116  Da  1122  \»1,NFV 

D^  1113  I,1»\F 
1118  Tv'K  I  >«FEAT(10+Ij\) 

CALL  MVppBD(Bcev>TVl#TV?*^F) 

CALL  vSUM(X»Tvi*Y#Tv3/Tvl*^F) 
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91*. 

91b: 

914 

917: 

918 

91 Q: 

92' 

921 

92? 

923. 

92* 

925 

9?N 

927: 

928 

92" 

93C 

931 

932: 

933 

93*; 

935: 

93^ 

937: 

93.": 

939: 

94C 

941 

94? 

943: 

94** 

945: 

946; 

9*7: 

948; 

949 

95c: 

951 

95?: 

953: 

95**: 

955: 

956 

957: 

95  >* 

959: 

960 

961 

96?; 

963: 

96**; 

965; 

966; 

967: 

96* : 

969: 

970; 


1120 
1122 


1124 


1290 


1292 
1210 


2101 
2102 

2300 
2301 
2902 
2303 
2304 
?305 
2306 
2307 
2308 
2309 
2310 
2311 
2312 
2313 
2314 
2315 
2316 
2500 
2600 
2601 
2602 
2800 
2801 


00    1120    Iil^F 

rE>TM0+I*N)     =     ECALE»Tvi(I)     +0^ 

CONTINUE 

SET    MR.    8F    CBEFF,     VFCTt^S    TT    ZFPH 
FLA3( 3J.o 

OUTPUT    F£ATU(*E    VfCTPRS    A"  0    WFTUPN    T1'    CtfMTR^L    L»?l> 
S3     TH    4;,6 

EXECUTE    TRADEOFF    LISTING    FptIPNS 


Df"    1210    M«1*FlAc-.(4) 
s-3    »     ITv2("> 

*P  I TF (2/2307)     DATf;,ID#I;)1 
^ITE(2/1220)     Mr; 
1220    F*RMAT(x,$TPADEeFF     FRF?    FEATURE    MJMjjC'R       *,I?) 

!*P        B        ? 

IF- (^R    »5T.     1C)     GP    TP    l ?i  c 

Or    1202    I«l/N'Fv 

SC6RE(  I)     .    FEATV",    +     iQj     1) 

CALL    TKAQEf»FF(NC>N>F,\Fv,  FtAT,Tv]  *  0 • , TV2# NS' SC^RE, »P ) 

C»MTINUE 

FLAG(4)«0 

PETJfN    T0    CPNlTRr'L    L°0D 
G°    Tfl    Uij 


FQR 
F8RV 

rpR-1 

FRR^I 
FRP^ 
F?R1 

rpR*i 

FyRM 

F  =  R 

FSR'1 

r^RM 

f6Rm 

p9R 

p-RR 

F"5Rvi 

F^P'-I 

F=JR 

FSR^I 

F9r 

F*R 

FRr^ 

FgRM 

FgRM 

FgRM 

FpPn 

END 


AT(x#aTpADEr'FF    F9P*//X*  *PAT-?       $# 2 I3j //* X ) 

AT(iHJ/>,tCcFFFICTE\T    CiUDS?»/# 

Ct,Erc"«*»»»»»»»»»»«»»*»» 


i  »*»<#»* ) 


KT       KP  CR^ST 

AT(  I3#19A^) 
AT(]6I) 
AT(I) 

AT(     M'f) 
AT(     I,?.  I) 
AT(10I6) 
AT(I>,?A4) 

AT(jHi,fOATE  *#I4,*  ID  *,?A<*j 
AT(iHl) 

AT(y , 10F6»4*//) 
AT(>,jTyPE  **20l2) 
AT(),jacLAS  **20l?#//> 
AT(x*10l3///) 
AT( 
A" 
A" 

AT(?Ox*     13'     19A4) 

AT(X/*SELECTFp    SA-ipLEb*  ,/,x'*C|_ASS       i,  1 1  I  4#  /y  /  jsNyMntR    *,liU) 

AT(x*3,CLA5S«,l0ll;5) 
AT(?x*  10G12.4) 

AT(lHO**RVEf.  All    f-"EA>.*»//»\I12//,  1GG12-4) 

AT(/x/2l4/HGll.4) 

AT(/x*$KETMeC  *i  I2//V) 


'T(x*10l3,//) 

kT(x#  I3»  I-R#?l3'2l4#  I7#2<»*#**3J3«10IS) 
<T(x»*    N'P  ID    Ty    NFt#?'4x«*    CL$'10l8) 

v  T  (  ?  I  >  1 1  Ci ) 
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octal   dec 

OCTAL 

"EC 

BC  1  al 

JcL 

NAfE 

TYPE  CLASS 

lpc   *BRop 

Kl 

"F   TYPE 

CLASS 

LBC 

v^sr.yz. 

VAKE 

TYPE  CLAS 

S     L9C 

^.BiUb 

.... 

....  ..... 

.... .  ..... 

•  . 

..   .... 

..... 

..... 

L.... 

.... 

....  .... 

.1... 

-••"" 

A 

R  SCALAR 

Ufto?^     ? 

ATAI>        R 

SpR^G 

INTR[\ 

B 

K  SLAL 

AR   116*1? 

d 

oXBV 

R  ARRAY 

3l*3lC   roc 

CL*S      1 

ARRAY 

1755-C 

?0 

cos 

-  bLALA-V   116153 

2 

LBV 

R  ARRAY 

?*67iC  2roo 

UATE       I 

SCALAR 

115S7P 

1 

rtT 

R  SLAL 

AK   11637P 

? 

■>ISP 

R  ARRAY 

2c75lC   2ro0 

0" 

Jppo^ 

SPR'Ki 

EXTERN 

F16 

"  SLALAR   U607P 

d 

Pact 

R  SCALAR 

U605P      ~ 

FEAT       l 

ARRAY 

C766J.C 

*ooo 

FLAG 

I  AKWAY    11533P 

20 

PLBAT 

R  SPRIG 

IN.TR.P 

I 

I 

SCalas 

1157,,P 

1 

ID 

i  SLaL 

«"   llb70J 

I'Dl  ■ 

I  SCALAR 

U571P     1 

IS'CArd    I 

ARRAY 

0?6*iC 

19 

1° 

1  SLALA-<   llb/bR 

ITV 

I  ARRAY 

3?oiic    ?o 

itv?     I 

ARRAY 

3226jC 

10 

J 

1  SLAtAR   11577P 

JP 

I  SCALAR 

U576F      1 

K 

I 

SCALAR 

H6C1P 

1 

<1 

1  SCALAR   11635c 

<2 

I  SCALAR 

U636P      l 

<L 

I 

SCALAR 

U6tiP 

1 

<iBUE 

1  SCAJ. 

AR   HS66P 

L 

I  SCALAR 

U600F      1 

LC 

"UN  T     I 

SCALAR 

116 Z*p 

1 

LIST 

1  AKKAY     llb.')7P 

20 

M 

I  SCALAR 

ll&l*P      1 

MT\         I 

SPR?G 

INTRjN 

i-MOtr> 

i  Slalah   U572" 

P.p 

I  SCALAR 

H65*D      1 

MPRS} 

SPRIG 

EXTERN 

"t; 

I  SCALAR   116h.3° 

*SUM 

SPR?G 

ExTfcRi^ 

f*VPRRP 

SPP^G 

EXTERN 

i  SLALAK   U647" 

NC 

I  SCALAR 

U563P      1 

NCT         I 

SCALAR 

1156:P 

1 

SOT 

1  bCALAR   115603 

\F 

1  SCALAR 

U565P      1 

NF7         I 

SCALAP 

1156?P 

1 

^pcaN 

1  SLALAR   11567P 

*-S 

I  Array 

176L:6C     11 

NSAV        I 

SCALAR 

Q76*^C 

1 

\SPAN 

1  Sl*l 

Ak   116b0P 

nss 

I  SCALAR 

U573p      1 

NT 

I 

SCALAR 

1156^ 

1 

p 

«  SLALAK   11612= 

d 

PI 

<?  SCALAR 

11621P      ? 

PI 

J      R 

SCALAR 

U6??P 

2 

pj 

-  Slal 

AR   H623P 

2 

HP 

R  SCALAR 

1]625P      5 

PR 

»q       R 

ARRAY 

l75?.,C 

20 

;U 

n  SLAL 

A"   11631" 

2 

RESTART     SPP9G 

EXTERN 

SAVE        I 

ARRAY 

OOOjoC 

*000 

SCALE 

h  JtAL 

AR   H6S1P 

? 

SCBRE 

R  ARRAY 

3?C73C    4C0 

SE 

i/AL 

SPR9G 

EXTEpN 

SFEAT 

\      AKKA 

Y    i/6/*L 

10 

SJ.N 

R  SCALAR 

11617P      ? 

so 

?T     R 

SPR9G 

INtRjN 

TCBV 

k  akray    30611C 

?00 

TqINVR 

SPpBG 

txTERN 

T" 

1        R 

Array 

2013!C 

200 

TM2 

.,  Ah<KAY     ?-*41L 

POO 

TRADtSFF    SPP9G 

EXTER'. 

Transp 

SPR9G 

Extern 

TV1 

K  ARWAY    31765C 

20 

TV? 

R  ARRAY 

3?011C     ?0 

TV 

3       R 

ARRAY 

3?03cC 

20 

VlPP^O 

iRKB 

3    ExlER'J 

VePR^D 

SPR?G 

Extern 

VS 

JM 

SPR?G 

EXTERN 

■/.CUV 

«     AKRAY     31121- 

v  ?00 

X 

R  SCALAR 

ll6*5P      ? 

XB 

AR       R 

ARRAY 

l762lC 

?oo 

X3AKT 

k  AkhAy    3l  7<*  1 C 

V  .ga 

Y 

P  SCALAR 
8CTAL 

H633P     ? 

eCTAL 

z 

R 

ecTAL 

SCALAR 

116*3P 
■JCTaL 

?. 

PCTAL 

SCTAl 

LABEL 

L8C       LABEL    L9C 

LABEL 

L?C  ' 

LABEL 

L?C 

LABEL 

LSC" 

LABEL 

"L^C" 

••-•• 

.....      .....   ..... 

.  ...* 

..... 

..... 

..... 

• 

>..  . 

•  »••■ 

*  -••- 

..... 

1C 

O0C5* 

12  -;oo*i 

100 

00062 

101 

00'63 

1?1 

00072 

1*0 

0007b 

1*1 

00076 

151   'Oil, 

1«?2 

0016* 

153 

00231 

155 

0-275 

160 

0030  3 

300 

00306 

3c?   OC327 

310 

10*5* 

320 

OlliO 

33'i 

01166 

331 

C1?*0 

332 

01262 

3*0   0l?75 

350 

01333 

360 

013?1 

37- 

01*31 

380 

01*56 

38? 

01510 

38*   -1517 

388 

015?? 

390 

015?6 

392 

01556 

39* 

01571 

39ft 

01601 

*00   0162? 

hQI 

01676 

*02 

017^? 

*14 

0i7n* 

*C6 

02056 

*09 

02117 

*10   021*1 

*11 

021** 

*20 

02165 

*5- 

02176 

*6C 

02?01 

*7o 

02211 

*80   02223 

500 

0??*6 

502 

02?7* 

51" 

C?337 

520 

02361 

525 

02*00 

550   02*7* 

551 

025-1 

552 

027<,6 

55* 

0?777 

6C0 

0J02/ 

605 

03067 

&10  :;3i*f 

620 

132*5 

630 

0331  1 

6*0 

03*3* 

6** 

03**2 

6*5 

03**6 

650   .363? 

661 

-3667 

662 

03737 

67 ', 

0«102 

67?" 

„*16* 

67* 

0*2*0 

676    *315 

678 

'.*37l 

679 

C**-35 

68-. 

0*553 

681 

0*651 

682 

0*706 

68*    5c5l 

686 

-5177 

688 

053?6 

69- 

05365 

69? 

05*7- 

69* 

0552* 

7C2   '563* 

7C* 

057*7 

706 

06U3 

708 

06212 

710 

0632/ 

800 

06333 

8j5   065*1 

810 

0.6775 

820 

07Cc* 

»3- 

07171 

8*0 

07323 

8*2 

07*00 

8*4   r7*03 

1100 

07*5Q 

1101 

07*<.* 

110? 

07570 

1103 

C'616 

110* 

07665 

lio5   :;767- 

1110 

0767* 

1112 

10C1 5 

HI* 

10C33 

1116 

1005C 

1118 

10070 

11?0   1C137 

1122 

10161 

112* 

1016* 

l?O0 

10167 

12C? 

1U?61 

121C 

10316 

1220   1022? 

2101 

103?* 

2102 

103^7 

2300 

10365 

23U1 

1U371 

2302 

1037* 

23o3   10376 

23C* 

10*01 

P305 

ic*-->* 

?30ft 

10fcC7 

?3C/ 

10*12 

2308 

10*22 

?3d9   10*25 

2310 

10*3? 

?311 

10*37 

231? 

l--**5 

2313 

10*5] 

231* 

10*63 

23l5   10*76 

2316 

10501 

2500 

10S;6 

260'. 

lr;526 

2601 

1053* 

2602 

105*0 

2»oo   10553 

23Cl 

1056O 

3100 

0C5e7 

311". 

0^623 

3112 

0U673 
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311*   03753 


31i5   0076* 


3116   01C15 


3120   01"37 


3123   01043 


L8CAL  VARIABLES  (102  W8PCS)! 


11507  LIST 

11533 

FL*G 

115^7 

DATE 

11560 

NDT 

H56l 

^CT 

11562 

NFV 

11563  NC 

11564 

NT 

115*5 

NF 

11566 

kmBqE 

11^7 

NPCR., 

11570 

ID 

11571  IOi 

1157? 

M9CF? 

1157? 

NSS 

1157* 

I 

ll575 

IP 

11576 

JP 

11577  J 

1160.'. 

L 

116;i 

< 

11602 

A 

Il6r4 

LCOUnT 

11605 

FACT 

11607  Fl6 

11611 

<L 

11M? 

P 

1161* 

M 

ll^lS 

CHS   " 

11617 

SlN" 

11621  DI 

11623 

PJ 

116P5 

PP 

11627 

pu 

II63I 

Q  I J 

11633 

Y 

11^35  <1 

11636 

<2 

116-J7 

CET 

116*1 

b 

116*3 

7. 

1164b 

X 

U6<»7  N 

1165' 

NjSFA": 

116=1 

SCALE 

11653 

MQ 

H6c4 

MP 

dLANK  COMMBNj  ,13771  i*8RDS)! 


00000  SAVE 

17574  SFEAT 

24671  CBv 

32011  I  TV 


C7<,*<"  MSAV 
176CA  MS 
30611  TCPv 
3?0ll  TV? 


076*1  IVCARD 

l76?l  XBAR 

311?1  *C?V 

32o"55  TVS 


37664  FjrAT 
20131  TH1 
31*31  bCBV 
32061  ITV2 


175?4  P«BB 

2 -4*1  TM2 

317*1  XBA"T 

32073  SCOPE 


17550  CLAb 
20751  DlbP 
31765  TV1 


INTRINSIC  SU9p:?9GRAMS  USED: 
ATAN         TL9AT        MIN 


SG-KT 


EXTERNAL  SUbcR^G0*^?  »L3lJl"Ef: 


D^DpRSD 
T«ANSP 


^lp»9D 
VIPR10 


KSOK 
VppKRp 


vsu^ 


RFSTART 


SEvaL 


TEXIM\ 


TpADrOFF 


HI3HtST  EW"8R  SEvERITy:  C  ( N°  FRP9RS) 


DEC 
wRRDS 

GENERATED  CflOF.:   *8?2 

constants:    36 

temps:    77 

l8cal  variables!   1"? 


T8TAL    sPSgRAM:       5037 


8CTAL 
toPKDS 

113T6 
OCC** 
00115 

ori*6 

11655         (PLUS    5LAv<    cp^BM) 


E'-D    8F    C9"1PILATI9^ 
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1  s 

2: 

C 

3: 

4 : 

C 

b '. 

C 

t : 

c 

7: 

c 

y  • 

c 

a  ' 

c 

1  : 

ll: 

c 

1?: 

c 

13: 

l*: 

1&: 

10 

16: 

17: 

18: 

is: 

20 

2c: 

21 : 

c 

2^: 

c 

23: 

c 

24  j 

c 

2*: 

c 

26: 

c 

27: 

2*: 

c 

29: 

c 

3c: 

31 : 

32: 

33: 

3**: 

3C 

35: 

3t-.: 

37 

38 

:  c 

39 

:  C 

4C 

41 

42 

43 

44 

:  C 

45 

:  c 

46 

47 

4« 

49 

5C 

:  4o 

51 

52 

:  50 

53 

SJBS9UTINE.  5EVAU  A,E"V,  LAMBDA,  %,  lv,\l) 

01  MENS  I eN  A  (  1  0/10)  '  B  (  1  Op  10)  #  I  V(  1  0  )  »  EV  (  10  ) 

A  IS  THE  ,\  BY  N  SYMMETRIC  INPUT  MATRIX 

BIS  AN  \  bY  N  wrR<lNG  ARWAY 

]\l     IS     A\     INTEGER    W6PKINC3    ARRAY    ?P     M    ELEMENTS 

rv  (RE*U)  CONTAINS  TH^  EIGENVECTOR  rn  e*IT 

»EAL  NE*LAM,LAM&DA 

INITIALIZE  LAMBDA  ,  \/     (     TRACE  ?F  INVERSE  9F  A  > 

D9  10  J«l/N 

?( i'j)»A( i#j) 

CALL   TDlKVR(Kl^K?#viN^#10/  IViOET) 

T»0» 

D6  20  I»1*N 
T«T*B( U I) 
LAMBDA-i ,/T 

GENERATE  UP  T8  ten  tepms  in  the  sequence 

EV(1».N-1)  3  (  ( A( 1 . .\-i#t. .N-1  )-LAMgDA#I ) INVERSE  ) *  A ( 1 . , \- ^ , \ ) 

EV(N)  »  1 

LAw3lJA  .  (Ev'«A»Ev)  /  (ty/'«Ev) 

D£»4r>K«l*l-; 

CALCULATE  EV 

D?  30  Ul*N-l 

?(  1/  I  )«LAMBOA-A( 1,1) 

D9  3n  J«I+i,N-l 

?(  I,J)"B(J,D»-A(  I, J) 

CONTINUE 

CALL  TDlNvR(  <l,K?>  N-  j  ,'\-l  #  9  j  1  r>,  I  v*  DET  ) 

CALL  MVpRbD(B,A(l,N),EV,N-n 

FV(N)«1. 

CALCULATE    LAMBDA 
CALL    v"lPR6D(EViEV,VMAG#N) 
CALL    MVpR8D(A,EV,B*N) 
CALL    VIPR6D(EV,E/NEwLAM,N) 

NEWLAM.NEwLAM/VMAG 

IP    39NE,    A(N,i.,N)#EV    ,    LAmbda»EV(\I) 

CALL    VlPR6D(A(1,N),EV,T,N-1 ) 

T.A3S(NEwLAM-T-A(N,K) ) 

IP(f .LltlQ«E>8)    OS    T8    so 

LAMBDA-NEaLAM 

CQNTINUE 

B'JTPUTO)  "SEVAL  NST  CONVERGING' 

RETURN 

END 
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BCTAL    DtC 

8ctal 

DEC 

HL  r  a^ 

DrC 

••AME 

tvpp;  Class 

L«C    wBRDP 

na^e   tydE 

CLASS 

L^C 

*SRD=> 

►  AME 

rYot 

CLASS 

L9c" 

►  e^Ub 

.... 

....  ..... 

.....   ..... 

....   ... 

..... 

..... 

_...• 

..... 

;..- 

..... 

.1... 

-• .  •• 

A 

R  APRAY 

•00003P  DU^fy 

AdS 

R 

SPP°G 

INTRjN 

R 

N 

ARKAy 

•OCCOfcP 

cv-^r 

'v£T 

R  SCALAR 

00535°      ? 

tv 

R 

ARRAY 

•  OOOt^P 

DUMMY 

! 

1 

SlAlar 

CC531= 

"1 

IV 

I  ARPAY 

•00007P  DUr^Y 

J 

I 

SCALAR 

0053?P 

1 

< 

1 

Scalar 

OCbulP 

1 

<1 

I  SCALAR 

0C533P      1 

K? 

I 

SCALAR 

0053<,P 

1 

LAMBCA 

A 

SCALAR 

•0C005P 

DJyMY 

."vPfeD 

SPC^G 

txTtPk 

N 

I 

SCALAR 

»0031;P 

DUMMY 

\E^LA"! 

H 

Scalar 

00527° 

~  a 

bEVAL 

P.  SCALAR 

0:525P      ? 

bEVAL 

SPPSG 

OOOO^P 

T 

K 

SCALAK 

00537P 

2 

1DINVR 

SPOQ 

txUP;' 

VI=Pf10 

SPRIG 

EXTER-M 

V"1AG 

R 

SCALAR 

00542° 

d 

eCTAL 

"CTAL 

BCTAL 

3CTAL 

8CTAL 

OLTAL 

LA3EL 

L^C       LABEL    L9C 

LAL-EL    L^C 

LA3lL 

"L°C 

LA^EL 

L9C" 

LABtL   "l 

.ec 

..... 

..... 

.....   ..... 

.....   ..... 

..... 

■--•• 

..  . 

...-« 

•  • 

..  -.   •  ■ 

>. .. 

l'c 

030*6 

?0   30121 

3C   00?P5 

*0 

oo*=5 

50 

00»"» 

LbCA^  vAPIAgLES  (15  *BPCS) 


0"525  SEvAL 
0C535  -3ET 


CQ5?7  niE'aLAM 
L0637  T 


COc?l  I 
00541  < 


00532  j 
005*2  ^«A3 


0G533  <1 


00534  <2 


cjlank  cb^mbn  c   a'ppjs) 

ENTRY  p6I\TS: 
00000  SEvAL 

IMTRIV.SIC  SU3pPP-pamS  USED: 
ArS 

ExTE^AL  SJBpP3GPAMi'  REQUIRED! 
MvdRBD      TOINvH      VlpPRO 


HIGHEST  ERR6R  SEvEPITy!  0  [Ne  EPP9PS) 


DEC 
wIRDS 

GENERATED  CADE:  317 

CBNSTA\TSI  13 

TE-os:  H 

L9CAL  VARIABLES:  15 


T6TAL  pRSqRa^:    3?fc 


6CTAL 
ftfRDS 

CC475 
00015 
0CC13 
00017 

0C544 


END    BF    C8^plLATI9\ 
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1 

2 

:  C 

3 

H 

5 

:  C 

f 

,  C 

7 

:  C 

8 

C 

9 

C 

lO- 

C 

ll! 

c 

1?. 

C 

13: 

c 

1*! 

c 

15! 

c 

16; 

c 

17: 

c 

18: 

c 

19: 

c 

20: 

21: 

2? 

23 

c 

2t: 

c 

25 

1 

2fe! 

c 

27: 

c 

28. 

29 

3C. 

5 

31  ' 

32 

10 

33: 

c 

3^ : 

c 

35' 

11 

36; 

12 

37. 

38! 

c 

39; 

c 

40: 

4l! 

4?: 

43: 

15 

44! 

20 

45: 

46! 

C 

47: 

c 

4«: 

49: 

?5 

50! 

51  J 

5?: 

30 

53: 

C 

54: 

c 

55: 

c 

56 ; 

57: 

58: 

35 

59; 

6C : 

36 


SUBROUTINE;  TRADpflFF  (  NC*  f<F  '  NFv  #  Feat*  TV  l#3#TV2#Ns>sCeRE*  MODE) 

DIMENSIPN  TVK lc)'TV2( 1 q) » FE AT ( ?o*2qO > » SC8RE ( 2q0) ' NS( q : 1q ) 
INTEGER  FEAT 

TABULAR  OUTPUT  PF  TRADEOFF  CURVE  DATA 

TEAT  VEC  SCeRES  ARE  RAN|<EU  AND  FFAT  VECS  8RDERE0  BY  SC8*E 

FEAT  >  FEATURE  VECTORS 

TV1-C6EFFICIENT  VECT8R 

3-CBNSTANT  TERM 

Ty2#NS/bC&RE   APE  TF^PBRAKIFS 

MSDE  «  1  CALCULATES  SCORE  Y  »  TVI'X+B  F0R  ALL  FEATURE  VLCT8RS  x 

KBDE-2'3/4  ASSUMES  SCARES  ARE  ALREADY  CALCULATED 

IN  MHDE.1/2  SC9PFS  ARr  OUTPUT  in  DECIMAL 

IN  M8DE.3  SC6RES  ARE  OUTPUT  IN  OCTAL  (INTEGER  PArTj 

*FDE«4  BUTPUTS  EFAT  1  -  10  ORDERED  RY  SCPRE 

MBDE. 11-14  SUPPRESSES  PRINTING 

LL  «  1 

IFK1BDE  »GT.  10)  KBCE  =  ^«DE  -  10i  LL  »  2 

G8  TO  (j,  jl*  \\t    11),  r^BDE 

LIST  COEFFICIENTS 

WRITE(2/1Q2)  BMTVl  (  I  )t  Imlt   >.F  ) 

CALCULATE  SCORES 

DB  1C  N«l,NjFV 

D^  5  I»li\F 

TV2(  I  )  »FEAT(  UlC/N) 

CALL  VlPR8D(TVl,TV2,Y,NF) 

SC8RE(N).y+B 

RAN<  THE  SCARES 
DO  1?  N»i,NFV 
FEAT( %t\) «Q 

DO  20  N»i,NFV 

SET  FEATO/N)  TO  RANK  BF  FEATURE  VECT8R  N 

K»0 

D8  15  I«1*NFV 

PsSCBRE(N) 

lF(sCRRF( i ) .LE»P)  KaK+1 

FEAT(9#N).K 

DO  30  N.jjNFV 

SET  FEAT(8/V)  Tp  L8CATIn\  «=>F  FEATURE  VECTOR  WITH  RANX  N 

<xFEAT(«*N) 

!r(FEAT(«,K) .EQ.O)  08  T£)  30 

K»<-1 

GP  T9  25 

r£AT(  J?<K  )  «m 

ORDERED  ByTPUT 

IF(LL  »EQ#  2)  GO.  TO  99 

0^  35  UC/IC 

nsc  I  )«6 

3°  T8  (37,  37,  ^7#  -^6),  V«DE 
*PITE(2,  1Q4)  I,     I  r  1/  10 
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61:  GB    T8    38 

62:  37         WRITE(2*100)     IM-OjNC 

63:  38         De    60    N.l^NFV 

64;  J«FEAT(8,N) 

65:  <»FEAT(10/J) 

66:  KS(<)«NS(K)*1 

67:  Gfi    T8    (40/    40/    45,    50)#    MODE 

68:  40         WRITE(2,101)    NmFEAT<  I,  j)  1 1.  1  ,3)  ,  (  FEAT<  I,  j)  ,  L5/7)  #«'SCORE(  j) 

69:  1       #<*NS(K) 

76:  G9    T9   6c 


71:     45 

721 


G8    T8    6c 

WRITE (2, 103)    Ni (FEAT( I# j) #  Z.l#3)« ( FEAT( I, J) , I .5*7) »K* ( LL.SC8«E< J) ) 
1       ,<*NS(K) 
73:  38    T8    6C 

74;      50         WRITE(2,    105)    N,    FEAT(i,    j),    K,    SC8RE(j),     (FEAT'd*    j),     I    .    H,    20) 
75:       6C         CONTINUE 
76:       99         RETURN 
77:    C 

78:       100      F8RMAT(7X#*NB  ID    TY*M6X**CL  SCORE      *,HI3) 

79:       101       FQRMAT(X'2I4*I8/I3*2I4* I7'I3*F14.4*N(3X)/I3) 
Rn»       m?       rsDMAT  i  v  .  .rsrcc*  .  /v  .  1  1  r »  r,  •  e;  \ 


102  F8RMAT(x**C0EFF*#/X#HFl0«5) 

103  reRMAT(x#2I*'l8*I3'2l**l7iI3#6X'08#N(3x># 

104  F9RMATJ7X/  $Ne  CL        SC8RE   *,  1016) 

105  F8RMAT(x*  214,  13,  F14.4,  1016) 


80 

81:   103   F8RMAT(x#2I*'l8*I3'2l**i7iI3#6X'08#N(3X)#I3) 

82; 

83 

84:        END 
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8CTAL 
,ame   T*DE  CLASS    L8C 


DFC 
»8PDS 


6  R  SCALAR  .0C010P  DO'*''  v 

J  I  SCALAR  0]030F      1 

?8DE  I  SCALAR  •OoCl*p  DUl"MY 

NF  I  SCALAR  »OOOC*p  Dum^y 

S  9  SCALAR  01026P      ? 

TRADE9FF  SPP9G  OCDO00 

VIPRHD  SPPSG  ExTER'v 


BCTAL 
NAv,e   TYpE  CLASS     L9C 


DEC 
*HRD:> 


(•EAT 
K 
N 
NFV 

SC9RE 
Tvl 


I  ARRAv 
I  SCALAR 
I  SCALAR 
I  SCALAR 
R  ARRAY 
R  ARRAY 
R  SCALAR 


•00006P  CUMMY 
01D2=.P  1 
Cl02?p      1 

•OCOOrP  DUMMY 

•  OOCI3P  CUM^Y 

•OOOO7P  CUMMY 
0l0?3p      2 


\A^E   TY=t  CLASS 


OC.TA.    UrL 
LSC    ftOsUc 


I         1  SLALAW  01021P  1 

LL        t  bLALA*  OICPOH  1 

\C        1  SLALAW  .O0003p  UU^Y 

NS         I  AKHAY  .0C012P  OUy"'Y 

TRADE9FF  *  SLALAk  01016P  "2 

TV2  '      x  Akkay  »00011p  UU^y 


8CTAL 
LABEL    LSC 

1  00052 

20  00256 

38  00*16 

100  00672 


LABfL 


9CTAL 
L9C 


5  roil? 

25  -0311 

*0  "0*57 

l'l  0C7Q7 


PCTAL 
LABEL    L9C 

10  00156) 

30  003'5 

*b  -)0537 

1C2  0072? 


LABEL 


OCTAL 
LSC 


LABEL 


11  00167 

35  003*7 

50  006?2 

103  007^1 


9CTAL 
L9C" 


LABEL 


12  00177 

36  0036* 

61  0C666 

10*.  007** 


eci  al 

L»C" 


lb  0U2*2 

37  00*01 

11  0U671 

10^  0L'7bb 


.8CAL  VARIABLES  (11  k8kDS): 

01016  TRADE8FF    ;102'J  LL 
01C26  P  : 1030  J 


01021  1 


01022  N 


010?3  Y 


0102b  < 


BLANK  CBMf*8N  (0  *J9RDS) 

entry  p9ints: 
00000  tradebff 

external  subpR9gpams  required! 

VlpPBD 


hIqHEST  EPP8R  SEvERlTy:  0  (MP  EPRBRS) 


generated  c8de: 

c8nstants: 

hemps: 

lbcal  variables: 


DEC 
»(8«DS 

501 
15 

10 
11 


TOTAL  pRSgRAm:    537 


8CTAL 
hPPDS 

00765 
00017 
00C12 
00013 

01031 


E'<D  8F  C8^PIL*TI8N 
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l:  sjbbputine  viprpo< A,e,c,^) 
?:  c 

?:  DiMeNSie-N  A(io)»Pdo) 

<•:  c-o« 

b:  ^1  10  li|»N 
t:  10   c»C*a<  I )»d( I ) 

7:  RETJHN 

«:  e^d 


octal   dec 
name  type  class   lbc   wbrds 

NA^E   TYPE 

BCTAU 
CLASS     LBC 

DEC 
*8RDS 

NAME 

BLTAL    OfL 
TYPt  CLASS     LBC"   «BrUs> 

....   -..•  .....    .....   ..... 

....   .... 

.....    ..... 

..... 

.... 

....  .....    .....   .._.. 

A          R  ARRAY   »000o3P  DUM^Y 
I         I  SCALAR   CD053P      1 
VIPRHD      SPR^S    OOOOOP 

B          R 
N          I 

ARRAY   .OOOO^P 
SCALAR  »00006p 

DUMMY 
DUMMY 

c 

VlPKBD 

m  slalaw  .OOOObP  'JUm'iy 
K  SLALAX   00051P  "   ~d 

fiCTAL            RCtAL 
LA-iEL   LPC      LABcL   L8C 

tC^AL 
LABEL    LBC 

OCTAL 
LABEL    L»C 

LABEL 

BCTAL 
L9C" 

MCTAL 
LABEL    LBC" 

.....     »....           .....     ...a. 

.....   ..... 

.....   ...M. 

..... 

..... 

.....   ...»• 

lc:  ooo3o 

wBCAL  VARIABLES  (3  *8RCS>: 
0C051  VlpRPD      00053  I 

dLANK  C8M*0N  (0  wBRDS) 
ENTRY  POINTS: 
OCOOO  VlpRBD 

HIqHEST  ERR8P  SEVERITY!  0  ( NP  E"P9RS) 

DEC       OCTAL 

wBRDS     wPRDS 


GENERATED  C8DE  !  36  000** 

CONSTANTS:  3  0CO03 

temps:  2  00002 

L3CAL  VARIABLES!  3  0CC03 


T8TAL  PROGRAM:     »0      00054 


EAD  Qf    C0MPILATI8V 
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l: 

?:  C 

<* : 
5: 
6: 
7: 


10 


SJBR8UTINE  V9PRrr(A,B,C#M 

PI  MENS  IBM  A(JC),P(1C).C(10M0) 
09  10  t. 1 «  N 

Dfc  10  J.1,N 

C(  I,J)»A( I )«B(J) 

RETURN 
END 


OCTAL   Drr 
NAME   TY=E  CLASS     LPC    «8RDS 

A         R  ARRAY   «0-J0o3P  DU^Y 
J         I  SCALAR   0C106P      1 
V9PR9D    R  SCALAR   OolO*P      ? 

na:"e  type 

B         R 
J         I 
V»PRf)C 

9CTAL 
CLASS     L9C 

ARRAY   •CGOC^P 
SCALAR   00107p 
SPR"3    OOOC-oP 

DEC 
a9R0S 

DUMMY 
1 

NAME 

C 

N 

OCTAL 
TYRt  CLASS     L9C" 

k  AKKAY   .00005P 
1  SLALAK  «00006P 

DcC 

JUmMY 

DU«my 

8CTAL             PCTAL 
LABEL    L6C       LABEL    L9C 

10   000*1 

^CTAL 
LABEL    L9C 

OCTAL 
LABEL    L?C 

LABEL 

PCTAL 
L8C 

OCTAL 
LABtL    LPC" 

tBCAL  VARIABLES  (*  *PRDS>: 
0010*  V9pRPD      0C10*  I 


CO  1.-7  j 


ULANK  Cn"!M9N  (0  «9RUS) 
ENTRY  PBIMS: 
00000  VBpRPD 


HlGwtST  ERR9R  SEVERITY!  0  (NP  FRR9RS) 


DEC 

wanes 


TOTAL  pRBQRAM! 


72 


ecTAL 

k*FRDS 


3ENt»ATED  C90E: 

58 

0007? 

cevSTANTS! 

c 

0C005 

TEmos: 

5 

00005 

L9CAL  variables: 

n 

0000* 

0C110 


END  Bf  CPMPILATI^N 
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l: 

2:  C 
3: 


SJBRHUTlNt  VSUM(Sl#A*S?,B'C»M) 


DIMENSION  A(lo)*B(10)#C(10) 

*:      Dp  10  i.liN 

5:   10    C(  I)  -SLAi  I  )+S2.K<  I  ) 
t:        RETURN 

7:      emd 


\AM£ 

OCTAL    Dt"C 
TYPE  CLASS     LOC    «ORDS 

Name   TYPE 

BCTAL 
CLASS     L8C 

DEC 
wBRDb 

NAME 

OCTAL 
TYPt  CLASS     lBC 

DE<- 

•  >•• 

•  -••  •-..•    •..,.   .*.«• 

••>•   .••. 

••«•«    ■•••. 

>••«• 

•  •-• 

•«••  >••>•    >•••• 

«•  .•• 

A 

I 

S2 

R  ARRAY   .ODOOtP  DUfMY 
I  SCALAR   00063P       1 
R  SCALAR  <>000'J5P  DUMMY 

B          R 

N            I 
VS'JM       R 

ARRAY   .00006P 
SCALAR  »000lop 
SCALAR   00061P 

DUMMY 

CUMMY 

2 

c 

SI 

VSUM 

K  AKKAY    .00007P 

k  scalar  .00003p 
Sp^bg   ooooop 

DUmMY 

wA3EL 

OCTAL              "CtAL 
L8C       LABEL    LOC 

LA! 

BCTAL 

>rL        LOC 

OCTAL 
LABEL    L0C 

LABEL 

BCTAL 
L»C" 

OCTAL 
LABtL    LOC" 

•---- 

•••••           ••«».     .a... 

.«-   •.••• 

•.•••   -•-.- 

•  •••• 

•  •••• 

•••••   ••••• 

10 

00C33 

LOCAL  VARIABLES  (3  "PROS)! 
00061  VSUM        00063  I 

3LANK  COMMON  (D  «9RDS) 
ENTRY  POINTS! 
00000  VSUM 


Hl3HtST  ERROR  SEVERITY:  0  (NO  FRP9RS, 


DEC 

wBRDS 

OCTAL 

rfPRDS 

3enerated  code: 

constants! 

te*ps: 

local  variable's: 

*2 
3 

3 

00052 
0C003 
0CC04 
0C0C3 

TOTAL  PROGRAM! 


52 


0C06* 


END  BF  CBMPILATI8\ 
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1 

sjbrbuJine  MP»ec<A»e»c*/ML>/> 

2 

C 

3 

C 

A  IS  Nl#N2,  B  IE  N2«N3»  AN?  c  IS  RETURNED  Nj«N3 

4 

DIMENSISN  A(l0< 10)»B(10/10)»C(10. 10) 

5 

Ml.M(l) 

6 

lF(fEo.3)  oe  Tfi  ? 

7 

C 

8 

C 

IF  8NLY  Nj  8R  Ni  AND  Mg  SPECIFIED  THEN  N3  .  N2  «  Mj 

9 

\?«N3«Nl 

1C 

Gf»  T8  3 

11 

a 

N?«N(?> 

1? 

K'3«N(3> 

13 

3 

CONTINUE 

1* 

09  20  I«1*N1 

15 

D8  20  J.1,N3 

16 

C( I»J)>0- 

17 

D9  lc  K»1»N2 

18 

10 

C(I»J)»A(I,K).B(K/J)+C(I»J) 

19 

20 

C9NTINUE 

2C 

RETURN 

21 

END 

NAME   TYPE  CLASS 


*3 


9CTAU 
LSC 


DEC 
*8KDs 


R  ARRAY  »00003P  DUMMY 
I  SCALAR  0C166P  1 
I  SCALAR  0-16?P  1 
I  MULDMY  »00006P  DUNMY 
I  SCALAR   0Q165P      1 


name  type  class 


9CTA|_ 
L8C 


□  EC 
W9RDS 


B  R  ARRAY  »00004P  DUMMY 

J  I  SCALAR  OOI67P  1 

MPR«D  I  SCALAR  OOI61P  1 

Nl  I  SCALAR  OOI63P  1 


NAME   TYPt  CLASS 


OCTAL    DEC 
L8C"   wBi?Us> 


C  K  Ankay   .00005P  UU"My 

K  I  SCALAR   00170P  "   "1 

MPR9D  '  SPRBG    OOOOOP 

N2  J  SCALAR   00164P      1 


9CTAL  9CTAL 

LABEL    L9C       LABEL    L8C 


0003* 


n0C*£ 


8CTAL 
LABEL  -   L9C 

10   00103 


BCTaL 
LABEL    L9C 

20   00137 


BCTAL 
LABEL    L8C" 


OCTAL 
LABtL    L5C" 


L8CAL  VARIABLES  (8  W9RGS) 


00161  MpRBC 
0G167  J 


00162  L 
00170  < 


00163  Nl 


0016*  \g 


00165  N3 


00166  I 


BLANK  C9MMBN  ,3  wBRUS) 
ENTRY  P9INTSI 
00000  MpRSD 


HlGMtST  ERR9R  SEVERITY!  0  ( Np  ERR9RS) 


DEC 
*9R0S 

GENERATED  C9DE!  102 

CBNSTANTS:  b 

TEMPS!  6 

LBCAL  VARIABLES!  8 


T6TAL  pRflQRAM! 


121 


BCTAL 
WFRDS 

001*6 
0C0C5 
0C006 
00010 

0C171 


END  BE  C8MPILATIBN 
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SUBROUTINE  MVPRf-C[  A,B»C,N> 


3: 

DIMENSION  A(  1C»  1P)*B(10)'C( 10) 

* : 

De  ?o  1»i<n 

5: 

C( I)-0« 

6: 

De  io  j.i*n 

7: 

10 

C( I > -C( I )♦*( I«J)«B< J) 

y : 

ao 

CeNTINUE 

9: 

PETJRN 

ic: 

END 

OCTAL    DEC  9CTAU    DEC  HLf»L    Uf L 

NAME   TYPE  CLASS     LOC    WORDS        NAMp   TYPE  CLASS     LOC    WORDS        name   TYPt  CLASS     lBC    »0-}Js 

A  R  ARRAY  »00003P  DUMMY  B  R  ARRAY  »000.">i»P  DUMMY  C  K  A**Av  »03005P  JU« ''Y 
I  I  SCALAR  0011*P  1  J  I  SCALAR  OOU5P  1  mvPROq  1  SCa|_aw  00113d  "l 
MVPROD      SPR8G    00000°  N         I  SCALAR  .OOODfeP  DUMMY 

OCTAL  6CTAL  OCTAL  3CTaL  OCTAL  3LTAL 

LABEL    LOC       LABeL    LOC       LABFL    LOC       LABEL    LOC       Label    L»C"      L*Btl    LbC" 

IC   000*7        ?o   00075 

LOCAL.  VARIABLES  (3  WORDS)! 

00113  MypRBD      0011*  I  00115  j 

BLANK  C0MM8N  (0  WORDS) 
ENTRY  POINTS! 
00000  MypRBD 

HIGHEST  ERROR  SEVERITY!  0  (NO  ERRORS) 

DEC      OCTAL 
wORDS     WPRPS 


GENERATED  CODE t  65  OC101 

CONSTANTS!  5  00005 

TEMPS!  5  00005 

LOCAL  VARIABLES:  3  00003 


TOTAL  PROGRAM!     78     00116 


END  Of  COMPILATION 
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l:  S'JBSSUJine.    MSUM(Si/A,S?»B'C»^) 

?:  C 

3:  dimEnsipn  A(ir#iO)»?( io<io)#C(1d»io> 

*:  09  ?0  I.l/M 

5!  D9  Id  J»liN 

6:  10    C( 1#J)«S1.A( I,J)*S2.B( I, J) 

7:  ?0    C9NTINUF 

»'.  RETURN 

v:  fnd 


»CT*L    DFC  6CTA|_    DEC  BCT»L    DrC 

\AM£   TY°E  CLASS     Lf)C    /.9RCS        n'A"F   TYPf.  CLASS     L9C    uPRD1-        t.AME   TVPt  CLASS     L9C   -.OpiJb 

A  R  AROAY  «OC'OC*P  DUMMY  p  R  ARRAY  »0000<;P  DU««Y  C  K  Akway  .000C7P  DU-^Y 

I  I  SCALA=  0c1v?=      1  J  I  SCALAR  00lj-jP      1  ".SU'I  1  SCalaw  0Cl0lJ  "   "l 

'SUM  SPC9G  0CCG0P  N  I  SCALAR  •C00l-p  DUMMY  si  *  ScAla*  #00003^  JUVY 

§2  R  SCALAR  »O0CO^P  CU^Y 

6CTAL  PCTAL  eCTAL  «CTaL  «CTAL  ICTAl 

LABEL    L9C       LABfL    L9C       LA»EL    L^C       LA3EL    L"C       LA3EL    L9C~      t'Htt    ^C 

ic  ooo»3       ?o  roofc* 

L.BCAL  VARIABLES  (3  ^eRUS)  ! 

OOiol  1SUM        r.0ioc  I  001^.3  J 

BLANK  C9MMBN  (Q  a'HRDS) 
ENTRY  P9INTS: 
00000  MSUM 


hIqhEST  ERR9R  SEVERITY!  0  (Nn  ERP9RS) 

DEC       8CTAL 
*9RDS     WPROS 


GENLRATEO  C«CE!  56  00070 

CPNSTANTSS  k  OCOO* 

TEMPS!  5  00005 

LBCAL  VARIABLES!  3  0CC03 


TSTAL  dR9qRAM!     68      OflO* 


END  8F  C9MPILATI6N 
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l:  SJB'eUTlNfc.    DMDPRADl A,3,C»U,N) 

?:  C 

3:  DlMENSlBN  A(10)iB(10*10)»CtlO)»D( 10.10) 

*'.  09  ?0  1«1<N 

5:  os  io  j»i»m 

6:  io   D< I»j)»A(I)»B(I*j)«C(j) 

7:  20    CONTINUE 

8:  RETURN 

y:  end 


»CTAL         DFC  BCTA|_         OEC  MttAu         OfL 

>AME      TYPE    CLASS  L8C         »9RQS  NA'ir      TYPE    CLASS  L9C         »9RDS  NA^E       TYot    CLASS  uBc         oOrJs 


D 

i 

R  ARRAY 
I  SCALAR 

•UC006p  RU^KY 
!   001  Up      1 

UM0PR90 
J 

R  SCALAR   OOHpP 
1  SCALAR   OOllcP 

?. 
1 

CIDPR^U 

SPWRG   00 

1  SOLA*  .00 

LABEL 

SCTAL 
L9C 

RCtAL 
LABrL    LBC 

LAbrL. 

rctal 

L9C 

OCTAL 
LABEL    LHC 

LABEL 

SCTAL 
L9C 

0C7AC 
LABtL     L8C" 

•  •••> 

-•••• 

•  -■».   ••.-• 

•  •••• 

•  ..•• 

••.•-   ••..• 

•  •••  • 

•  .••• 

»•••«    ••••> 

11 

00045 

?C   1007'. 

L.9CAL    VARIABLES    (4    "PROS)! 

0M12    OMOpC«D  0011*    I  0011*    j 

•jLANk    CS^BN    (0    /*9RDS) 
ENTRY    PPIMS: 

00000  OMDpP-JD 


••'lGHtST  EBR9^  SE 

verity:  : 

j    (Nf  E"p9°S) 

CEC 

8CTAL 

«9*DS 

w'-RDS 

iENERATEO  CP^E! 

64 

0'  100 

csnstams: 

c 

0v;00b 

te*ps: 

5 

00005 

L8CAL  VARIABLfS: 

•* 

0000* 

T9TAL  pR8G"*,*i:     7?      0 C  1 1 6 


E'-D  BP  CSMPlLATiev 
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l: 

2: 
3: 

*: 
5: 
6: 
7: 
?: 
9: 


10 


SJBReUjINE  TRANSP(A,a,N, 

DIMENSI6N  A(l0/10)*E(10,10) 

DB  ?0  I«1,N 

D8  10  J.1,N 

B( I*J)«A( j,I ) 

CONTINUE 

RETURN 

END 


NAME   TYPE  CLASS 


BCTAL    DFC 
L8C    WBPPS 


A  R  ARRAY   »03C03P  DUMMY 

J         !  SCALAR   00077*"      1 
TRANSP      SPR8G    0cCC0p 


NAME   type  CLASS 


bct*l 

L9C 


DEC 


R  ARRAY   »0000uP  DUMMY 
I  SCALAR  •OOOC^P  DUMMY 


\AMfc   TYpt  CLASS 


8CT«_ 
L9C' 


JcL 


I  1  SLALAK   CT076P      1 

T^Af-Sp    A    SL*LAK   00074P      2 


8CTAL 
LABEL    LBC 

10   00035 


"OCTAL 

LABEL    L8C 

20   r0Q6," 


8CTAL 
LABEL    LBC 


CCTaL 
LABEL   'LPC 


9CTAL 
LABEL    L'C" 


BCl  Au 
LABtL    L8C" 


L8CAL  VARIABLES  (4  "PROS): 
0C074  TRANSP      CCO^ft  I 


^0077  j 


cJLANK  CBMM9N  (^  i^nRDS) 
ENTRY  P8INTS: 
OOCOO  TRANSP 


MlQHtST  ERR8K  SEVERITY!  0  ( NO  FRPBRS) 


3enerated  c8ce! 

cbnstants: 

temps: 

local  variables! 

total  prbgRam: 


DEC 

wBRDS 

52 
4 
4 
4 

64 


8CTAL 
uPRDS 

OCC  64 
00004 
0CC04 
QC0C4 

0O1C0 


END  OF  COMPILATION 
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1:        SJBSPUTINe.  TDINv^  (  ISSLilDSBLf  VR#NC,A*MRa,<WAjDET) 

2:  c 

3:  c    sjb^putine:  tp  find  the  inverse*  SPLvE  sets  OF  simultaneous 

4:  C      EQUATIONS,  AND/PR  CALCULATE  THE  DETERMINANT  0F  A  R^AL  MATRIx 

5:  c 

6:  C      IS9L  ■  1  IF  INVERSE  F0UND  P°  EfjUATJPNS  SOLVED, 

7:  C  ■  ?  IF  UNABLE  TO  SPLVE/  «  3  IF  INPUT  ERROK. 

8;  C      IDSPL  «  1  IF  N9  RVEPFLe*,,  «  ?  IF  PVERFLPw. 

9:  C      NR  IS  NuMbER  9F  RP*5  PF  A. 

1C:  C      ABS(NC)  IS  NUMBER  9F  C9LUM\<3  gp  a.   Me  INVERSE  F-3UN-D  IF  NC  IS  NEG. 

11:  C      FIRST  Nr  CSLU^NS  8F  A  F0RM  SQUARE  MATRIX  T9  BE.  I\jVERTED  8N  IVUT* 

12:  C      RETURNS  THE  INVERSE  PN  EXIT. 

13:  C      NEXT  A8S(NC)-NR  CPLUMNS  rF  A  are  C9K,STANT  VECTBRs  FPr 

14;  C      A3S(NC)-NR  SYSTEMS  PF  EQUATI9NS*  RETURN  SOLUTIONS  PN  EXIT. 

15:  C      MRA  IS  NUMBER  9E  PP.mS  RESERVED  F«R  A  IN  MAIN  PRPqRaM  DIMENSION. 

16:  C      <vmA  IS  *PRkINq  ARRAY  PF  THr  FORM  K*iA(NR). 

17:  C      <wA  MAY  BE  A  DUMh'Y  VARIABLE  IF  MP  EQUATIONS  A*E  yO  BE  SOLVED* 

18:  C      OET  IS  THE  VALUE  PF  DETERMINANT  IP  IS&L  .  IDSOL  x  1» 

19:  c 

20:  C  A,     <wA    TAK.E    THE    DIMENTlpNS    GIVEN    THEM     IN    THE    CALlING    PROGRAM 

21:  C 

22:  DIMENSIPN    A(1)*KaA(1) 

23:  IR.NR 

24:  IS8L    »1 

2b:  IDSPL-1 

26:  IF(NR)    6>i*61Ul 

27:  11    IF(I«-MRA)i?M2*61 

28:  12    IC-IABS(NC) 

29:  IP(IC-lR)    13*14,14 

30:  13   ic-IR 

31:  14    I3MP.1 

32:  J3MP-MRA 

33:  <gMP»JBMP+ IPMP 

3^:  NES«IR»JBMP 

35:  NET«IC»JBMP 

36:  IP(NC)       15*61/16 

37:  15    MDIV«JBMP+1 

3S:  IRIC-IR-IC 

39:  G?    T8    17 

40:  16    MDIV,1 

41:  *        17    vAD    -mUIv 

42:  MSER«l' 

43:  <SER»IR 

44:  M2     »i 

45:  DET.1.0 

46:  c 

47;  C  MAIN    L98P»*****««»«»  it*********************** 

4*:  C  RPW    9PERATlflNS    Pf*     MATRIX     TP     INVERT*     SPLVE    SYSTEMS'     CaLC«    OEt» 

49:  C 

50:  18    t>IV»0»0 

51;  l»MsEP 

5?:  C 

53:  C  FIND    LARGEST    ELF^ENT    IN    COL1-'"^    TH    pjv 

5<K  19    IF(I-KSER)  20*20*23 

55:  20    IF(ABS(A( I ) > -Pi  V) 22*22*21 

56:  21    PIV-ABS(A(  I) ) 

57:  IP. I 

58:  22    I-I+IBMp 

59:  GO    T9    lg 

60:  23    ir<siV)       24,62#?4 
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6i: 

br'. 

6?: 
6«»: 
6-: 
66: 
67: 

6M 

6?: 
7^: 
71 : 
7?: 
73: 
7<*: 
75 : 
7f: 
77: 
7^: 
79: 
80: 
81 : 
8c: 
83: 
8^: 
8^: 
8t : 
87: 
8?: 
89: 
9o: 
9i: 
9?: 
9?: 
9^ : 
95 : 
9f : 
97: 

qw  ; 

99: 
io:: 
101 : 
10?: 
10?: 
10*: 
105: 
lOh: 
107: 
10U: 
109: 

1 1"S 

111: 
11?: 
113: 
ll*: 
11*: 
ll<  : 
117: 
U': 

11": 

l?r : 

l?i: 


24  I"(mC)   ?b#?5#25 


25 


26 
27 


28 

29 


IvVEpSE 
NI3-{  ( 

JJ«MSEK 

n«jj+( 

<-mA(  JJ) 

SB  TB  2 
I«I° 

J.MSER 
IF( IP-M 


30 
31 


35 


136 


36 
37 


39 

*0 
M 


142 
42 
43 


4** 


145 


wanted.  ..^ccumulaTe:  inverse  and  save  P8INTEH  T0  Plv 
IP-1 J/JB^  P)*J3^P 
( (MSE»-1 )/Jd^P)*jB^P 
/Kbvp*l 
IP.MSER) 
.II 
7 


SER)  6l#Sl*2« 


3rT  PIvbt  ELEMENT  SN  WAIN  DUCTAL 


INTERCHANGE  PpwS  TB 

IF(J-NET)   ?9,2S#30 

PST6«A( I) 

A  (  I  )  ■  A  (  g  ) 

A( J) -PST8 

I-I+jBMp 

j.J+JB^P 

Gd  TB  28 

ACCUMULATE  DETERMINANT  AND  CWEC<  FBP  BVFRFLO* 
DET.-DET 

pstb.a(mser) 

det.dej.pstp 
call  bverfu  ivf) 

Ir(  IVF-1 )63'63#35 
PSTB«1«0/PST9 
CALL    DVCH*( IVF) 
IF(  IVF-4  )t»3«63J136 
CONTINUE 
A(MSEp)«l »0 
I»MDIV 

DIVIDE    PlvBT    RSv    BY    PTvOT 
IF(I-NET)  37,37,39 

A{  I)-A(  I ),PSTB 

UI*JBMP 
C    TB    3e 

USE    pIVPT    Rf>W    T.f     ZEKe    PIVBT    CBL'JMN    ELEMENTS 

IF(^Z-<SEh)     40> 40,145 

IF(^Z-MSEK)     41,44,41 

l.MAP 

J.M^IV 

PSTP.A(^Z) 

IP(PSTtf)     14?#44»J42 

A(MZ) -O.Q 

IF(j-\tT)  43,43,44 

A{  X  ).  ■  A  (  I  )-A(  J)*PSTB 

J.J+JB^F 
I-NjB^F 

30     TB    4? 
^•AD8vAD*IByP 
^7«^Z*IpMP 
3B    TB    39 
<r>E5«<SER*jt  ^P 

E  x  I  T     F^B^    ►"V  I'm    l_f»^P 
Jr(<SER-\ES)    46,4<-,^l 
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122 

:    *6 

MSER«MSER+KBKP 

123 

IF(NC)  -*8,*7/47 

12* 

:    *7 

"DIV«MDlv+IBMp 

12b 

N<Z"(  (M3tR-l)/jBMP)#jBMP4.l 

126 

MAD»1 

127 

GS  TB  5£ 

128 

:    *8 

MDlV-MOIV+KBMP 

129 

IF(IPIC)  50*49*50 

130 

:    *9 

MZ-MSER+IfiMP 

131 

G9  TB  5j 

13? 

50 

^Z"(  (MSER-1  )/jB^P)»JBMP+l 

133 

:    5i 

MAD«^Z+jBMP 

13* 

:    52 

G9  TB  18 

135 

C 

136. 

c 

END  MAIS  L99P#»****#***»# 

137 

c 

138 

:    53 

IF ( MC)  65*54*54 

139! 

c 

140! 

c 

BEGIN  INTERCHANGE  QF  C8lU 

1*1 

!     54 

JR-I" 

1*2. 

55 

IF(JR)  61,65,56 

1*3, 

56 

If(<wA{  JR)-JR)  61*60*57 

14* 

57 

Ka ( JR-1)#JB^P 

1*5: 

J.K* IR 

146: 

L« (<wA( JR)-1 )#JB^P+IR 

1*7 

58 

IF(J-K)    61*60*59 

14??! 

59 

PSTB.A(t) 

149; 

A(L)»A(j) 

150: 

A( J)«PStB 

151! 

J-J-IB^P 

152: 

L-L-IBMp 

153! 

G8  TB  58 

15*: 

60 

J3-JR-1 

155: 
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FEDERALLY  COORDINATED   PROGRAM  OF  HIGHWAY 
RESEARCH  AND  DEVELOPMENT   (TCP) 


The  Offices  of  Research  and  Development  of  the 
Federal  Highway  Administration  are  responsible 
for  a  broad  program  of  research  with  resources 
including  its  own  staff,  contract  programs,  and  a 
Federal-Aid  program  which  is  conducted  by  or 
through  the  State  highway  departments  and  which 
also  finances  the  National  Cooperative  Highway 
Research  Program  managed  by  the  Transportation 
Research  Board.  The  Federally  Coordinated  Pro- 
gram of  Highway  Research  and  Development 
(FCP)  is  a  carefully  selected  group  of  projects 
aimed  at  urgent,  national  problems,  which  concen- 
trates these  resources  on  these  problems  to  obtain 
timely  solutions.  Virtually  all  of  the  available 
funds  and  staff  resources  are  a  part  of  the  FCP. 
together  with  as  much  of  the  Federal-aid  research 
funds  of  the  States  and  the  NCHRP  resources  as 
the  States  agree  to  devote  to  these  projects.'"' 


FCP   Category  Descriptions 

1.  Improved    Highway   Design   and   Opera- 
tion for  Safety 

Safety  R&D  addresses  problems  connected  with 
the  responsibilities  of  the  Federal  Highway 
Administration  under  the  Highway  Safety  Act 
and  includes  investigation  of  appropriate  design 
standards,  roadside  hardware,  signing,  and 
physical  and  scientific  data  for  the  formulation 
of  improved  safety  regulations. 

2.  Reduction    of    Traffic     Congestion    and 
Improved  Operational  Efficiency 

Traffic  R&D  is  concerned  with  increasing  the 
operational  efficiency  of  existing  highways  by 
advancing  technology-  by  improving  designs  for 
existing  as  well  as  new  facilities,  and  by  keep- 
ing the  demand-capacity  relationship  in-  better 
balance  through  traffic  management  techniques 
such  as  bus  and  carpool  preferential  treatment, 
motorist  information,  and  rerouting  of  traffic. 


*  The  complete  7-volume  official  statement  of  the  FCP  is 
available  from  the  National  Technical  Information  Service 
(NTIS),  Springfield,  Virginia  22161  (Order  No.  PB  242037. 
price  $45  postpaid).  Single  copies  of  the  introductory 
volume  are  obtainable  without  charge  from  Program 
Analysis  (HRD-2),  Offices  of  Research  and  Development. 
Federal    Highway    Administration.    Washington,    D.C.    20500. 


3.  Environmental  Considerations  in  High- 
way Design,  Location,  Construction,  and 
Operation 

Environmental  R&D  is  directed  toward  identify- 
ing and  evaluating  highway  elements  which 
affect  the  quality  of  the  human  environment. 
The  ultimate  goals  are  reduction  of  adverse  high- 
way and  traffic  impacts,  and  protection  and 
enhancement  of  the  environment. 

4.  Improved  Materials  Utilization  and  Dura- 
bility 

Materials  R&D  is  concerned  with  expanding  the 
knowledge  of  materials  properties  and  technology 
to  fully  utilize  available  naturally  occurring 
materials,  to  develop  extender  or  substitute  ma- 
terials for  materials  in  short  supplv.  and  to 
devise  procedures  for  converting  industrial  and 
other  wastes  into  useful  highway  products. 
These  activities  are  all  directed  toward  the  com- 
mon goals  of  lowering  the  cost  of  highway 
construction  and  extending  the  period  of  main- 
tenance-free operation. 

5.  Improved  Design  to  Reduce  Costs,  Extend 
Life  Expectancy,  and  Insure  Structural 
Safety 

Structural  R&D  is  concerned  with  furthering  the 
latest  technological  advances  in  structural  de- 
signs, fabrication  processes,  and  construction 
techniques,  to  provide  safe,  efficient  highways 
at  reasonable  cost. 

6.  Prototype  Development  and  Implementa- 
tion of  Research 

This  category  is  concerned  with  developing  and 
transferring  research  and  technology  into  prac- 
tice, or,  as  it  has  been  commonlv  identified, 
"technology  transfer." 

7.  Improved  Technology  for  Highway  Main- 
tenance 

Maintenance  R&D  objectives  include  the  develop- 
ment and  application  of  new  technology  to  im- 
prove management,  to  augment  the  utilization 
of  resources,  and  to  increase  operational  efficiency 
and  safety  in  the  maintenance  of  highway 
facilities. 
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